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CHAPTER 1 


Al and Bot Basics 


This chapter covers the basics of bots, how they work, and their 
interactions with users. We will also touch on what exactly artificial 
intelligence (AI) is before moving on to discuss further details of chatbots 
and why they are necessary. 

Additionally, this chapter explains the connections between AI and its 
subsets of machine learning and deep learning. Finally, we will study the 
structure of AI and bots and cover available bot frameworks. 


Artificial Intelligence 


Artificial intelligence, or AI, is a buzzword nowadays. It is a branch of 
computer science gaining immense popularity. The goal of AI is to create 
computer systems that are independent and function intelligently. 

Alis easiest to understand when we describe it in terms of 
characteristics or capabilities of human beings. Let's explore how AI works 
with human beings or models human behavior. 

Human beings connect with other human beings through language. In 
the field of AI, we call that language exchange speech recognition. Because 
speech recognition is more statistically based, we call this type of learning 
statistical learning. 

Humans can read and write text. In AI, this communication process is 


called natural language processing (NLP). 
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Humans also can see through their eyes and process what they see. 
This kind of perception, when converted into the medium of AI, is known 
as computer vision. Computer vision falls under a category of computer 
science that deals with symbolic learning. 

When humans look at the world around them, they create pictures 
through their eyes. In AI terminology, this is known as image processing. 

Humans can recognize their environment and move around it freely 
and in any manner. When we replicate these kinds of actions in AI, we 
enable robotics. 

Humans have the ability to group patterns of like objects. In terms 
of AI, we call this pattern recognition. Machines are better at pattern 
recognition than humans because machines can use more data. Machines 


interpret the data as follows: 
1. The dataset is fed into the machine. 
2. The machine processes the dataset. 


3. The machine splits the dataset into training and 
testing data. 


4. The machine process the training dataset to create a 
model by using machine-learning algorithms. 


5. The machine compares the model with the testing 
data. 


6. The machine joins the training and testing data, 
evaluates, and finally visualizes the data. 
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Figure 1-1 illustrates this process. 





- == 


Figure 1-1. Machine-learning flow 
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Machines can deal with excessive amounts of data in datasets. As 
the machines try to interpret and learn from the data, without being 
programmed to do so, we call that process machine learning (ML). 

In the human brain, a network of neurons works on making decisions 
by actively working together. When the same situation is applied 
artificially, artificial neurons (These neurons are the basis of neural 
network) try to work similarly to biological neurons, and this behavior 
is called cognitive computing. When communication happens within 
neurons and they convey information and create a network on its own, 
we call it neural networks. When the network becomes too complex to 
understand, with complex datasets and many hidden layers involved, 
machines are performing deep learning (DL). 

When machines scan an image from left to right or from top to bottom, 
those machines form a convolutional neural network. 

Humans generally remember what they did yesterday or, for example, 
what we had for dinner yesterday. Machines that can understand the same 
sequential concepts form recurrent neural networks. 

Figure 1-2 shows that AI works in two ways. One is a symbolic-based 
approach, and the other is a data-based approach. Symbolic-based 
learning uses image recognition; generally, this technique is used for 
robotics. When we are dealing with huge datasets, we use the data-based 
approach, also called the machine-learning approach. 
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Figure 1-2. Two main approaches in the way AI works 


When we use the data-based approach, generally we are dealing with a 
lot of data that we need to learn from. Subsequently, machines will be able 
to predict better from early stages as they are now lots of data to work using 
this data-based approach. 

Let’s look at an example of how machines work with data. We have 
sales and advertisement data, and use linear regression to identify the 
relationship between them. Linear Regression deals with numerical 
values for a solution. We are trying get the Linear regression curve that 
fits the straight line equation that is y = mx + C, where m is the slope of 
the gradient C is the constant x is the dependent variable and y is the 
independent variable. First, let’s look at the data points in Figure 1-3. 
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Figure 1-3. Data points indicating sales vs. advertisement data 


Figure 1-4 shows some patterns, and now we can apply machine 
learning (ML) to it. After the machine learns the patterns, it can make 


predictions based on what it has learned. 


Advertisements 


PATTERN 








Sales 


Figure 1-4. The curve shows a pattern. The curve generated from 
sales increase pattern with respect to advertisements. 
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Whereas one, two, or three dimensions (The dimensional data are 
the data generated from information gathered) are easy for humans to 
learn, machines can learn in many dimensions. The high dimensional 
data has large amount of information example would be that for a 
famous personality we check for where they were born, how they came 
to limelight, their career all have some data but some valuable insights 
are required to get the best information so machine learning on high 
dimensions help the data readable and faster to access. 

Figure 1-5 shows how data is available in a high-dimensional space 
and the magnitude of the data associated with it. Machines learn from this 
high-dimensional data space fast and efficiently. 


High-dimensional 
Dataspace 


Figure 1-5. High-dimensional space 
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A machine can look at large amount of data within the dataset, 
which we call high-dimensional data, and determine patterns. After the 
machine learns these patterns, this valuable information gives useful 
insights leading to a lot of research, and again leading to faster-evolving AI. 
Machine uses the patterns to do two things: 


e Classification 


e Prediction 


Classification 


When we work with different kinds of datasets, we generally divide 

the datasets into observation types. We utilize the training data so that 

we can apply different machine-learning algorithms to it. When using 
Classification if we are trying to classify mail coming into our account as 
legitimate or spam we associate two levels either it will get inside the mail 
box or will be inside spam. We associate labels for it which determines the 
spam filtering process through classification. 


Prediction 


When we are working toward future readiness of a particular dataset, we 
generally run predictions by using the available dataset. The model we 
create after applying machine-learning techniques is a benchmark so that 
we can predict future outcomes based on this model. Machines generally 


learn in two ways: 
e Supervised learning 


e Unsupervised learning 
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Supervised Learning 


Supervised learning is generally based on available ground truth (we are 
sharing every resource for the data points such as inputs, outputs, and any 
other available information). Therefore, we are providing the machine or 
program with input and output. The machine goes through the available 
information and finally predicts. Regression is an example of supervised 
learning. Let us suppose we want to predict a price of a property in an area 
the model we created applying regression and the slope formula that is y = 
mx + C we can get a result that is far off from the actual property price the 
difference is the error in order to get the model more accurate and close to 
the result we will tweak the slope values to get the proper value. 


Unsupervised Learning 


Depending on the scenario, the dataset we're working with may not have 
any prior information available. We might be dealing with datasets that are 
not labeled or classified. In this case, we use unsupervised learning. 

Clustering is an example of unsupervised learning. 

There is a different way to deal with environments, and we call this 
branch of machine learning reinforcement learning. In reinforcement 
learning, we give a machine a goal and ask it to learn it from trial-and-error. 

Machines learn in the three ways, shown in Figure 1-6: supervised, 


unsupervised, and reinforcement learning. 
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Figure 1-6. Machines learn in three ways 


Interconnection Between Al, ML, and DL 


AI, ML, and DL, depicted in Figure 1-7, are separate terms. However, they 
do have interconnections, described next. 


Deep Learning 


Artificial Intelligence Machine Learning 





Figure 1-7. Al, ML, and DL 
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AI refers to a broad category of computing in which a system is capable 
enough to learn directly from data. This is possible because of a lot of 
interactions, analysis, structuring, and visual representations of data 
using data analytics. This is applied by sets of rules defined by human 
intervention or increasingly by the subset of AI that is also known as 
machine learning. 

With the advancement of ML, many things underwent changes, 
including processing the data and the way information is used. Data needs 
some form of automation to evaluated faster without the need for human 
intervention. ML deals with large data sets too. 

When we use a lot of data for our work, we reach a computational 
tipping point, which is when lots of data is gathered together and size is 
really huge to work with as depicted in Figure 1-8. This can result in new 
implementation methods in data analytics. 


COMPUTATIONAL TIPPING POINT 





Figure 1-8. Reaching the computational tipping point 
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A subset of ML known as deep learning (DL) was one result of reaching 
this tipping point. Figure 1-9 illustrates the relationship between AI, ML, 
and DL. 


s É c — $ e » 
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Deep Learning 
Machine Learning 





Artificial Intelligence 


Figure 1-9. The evolution from artificial intelligence to deep learning 


A neural network, illustrated in Figure 1-10, is another concept we will 
discuss in this book that has become popular. When analysing an image 
the first thing computer does is to break the image in RGB scale now we 
have different levels of abstractions for the layers. We need to access the 
layer in different way. So a neural network is generated and as we see if the 
level of abstraction goes beyond 3 it directly falls under Deep Learning and 
neural network is a part of it. 
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Figure 1-10. Neural network 


The neural network made sense of different connected neuron 
networks and produced outputs that brought groundbreaking results. This 
resulted in the progressive growth of AI in a broader sense for capabilities 
such as image, speech, and natural language recognition. This produced 
significant and positive impacts in our daily lives. The evolution of deep 
learning signifies that AI is not static and will grow and adapt accordingly 
as different techniques arise. One good example would be that we travel 
to a different place we don't know the language the capabilities of AI can 
take an image or the information that is there using the webcam and can 
convert it into easy english language. 
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Chatbots 


Chatbots they have come a long way. From being static to more on 
interaction. 

In today's world, we have to hide service layers within plain 
conversational techniques. We don't want to show whats happening 
underneath so we wrap the service layer and hide the logic so that we are 
not able to show the entire process of communication as many people 
want their technique to be secretive. 

For the best chatbots, we need to underline one thing. If a human 
being analyzes both a bot and a human conversation and is unable to tell 
the difference between the two, we say it passes the Turing test. However, 
until now, no bot has been able to achieve this feat. 

Traditionally speaking, chatbots have used what we call a retrieval- 
based model. In this model, a programmer's code provides predefined 
responses, and chatbots learn in a heuristic way to pick the appropriate 
response. 

The first chatbots ever created used rule-based expression matching. 
Now the approach has moved to using ML as a classifier for better 
responses. We can take as an example Facebook's API, for which we can 
hard-code responses and then classify words with intent. Then if we ask or 
phrase a query as, "What day is today?" or "Today is what day?" Chatbot 
understands both. 


Generative Chatbot Model 


A generative chatbot model relies on predefined responses, and whatever 
we do, we should write them from scratch. When we are working with 
chatbots, we first have to see whether we are working on a closed domain 


or an open domain. 
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Open Domain 


In an open domain, a conversation can go anywhere. There are infinite 
things to talk about. 


Closed Domain 


In a closed domain, a conversation focuses on a single subject or topic. The 
chatbots evolve based on the kind of conversation we want: long or short. 


Short conversations are easier to use. 


How Do Chatbots Work? 


The best way to learn how chatbots work is to first understand the brain of 
bot. We call this a digital brain, and it consists of three main parts: 


e Knowledge source: Where we need to find out which 
informations needs to provided to the bot so the 
conversation starts and for Q and A 


e Stock phrases: Its something where we can handle 
general phrases of conversation which is used more 


often 


e Conversational memory: When we are doing a 
conversation we have to remember the flow what has 


happened so conversational memory is required 


When we start communicating with a bot, we may send a message 
(for example, "hello"), and the bot starts working—or more accurately, 
analyzing the message. The bot's activity is known as parsing. Next the bot 
will look for keywords in order to reply to the message. 


15 


CHAPTER 1 AI AND BOT BASICS 


Then the brain of the bot will use its three main parts to analyze the 
message and then construct its reply. Figure 1-11 shows the structure of 
the bot's digital brain. 





aes 
an 
eel 


Figure 1-11. The bot's digital brain 
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Figure 1-12 shows how the response is generated from the digital brain. 





Figure 1-12. The response being generated by the bot 


Rise of the Chatbots—Conversational Commerce 


Conversational commerce uses chats, messaging, or some kind of natural 
language as its interface. Conversational means it uses some kind of voice 
or text medium to transfer data and understand how people communicate. 
What we are doing with chats and messaging is using this particular 
medium to easily interact with each other. To make our jobs easier to 
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answer simple queries for our business we feed the bot with common 
questions and answers so that we can save time before they go to the 
customer care if required. 

The advent of conversational commerce allows users to talk to 
companies and have companies also talk back in an easy manner. This can 
happen in three ways: 


e Bidirectional: That is the communication flow is faster 
and seamless within the bot 


e Asynchronous: Allowing the messaging to be controlled 
at timely mannere and not within specified time 


intervals 


e Inrealtime: The communication response is to make it 


realtime 


The Role of Chatbots 


In conversational commerce, chatbots are the computer programs used to 
simulate a conversation with a human. They use a text-based approach. 
Chatbots work on the following: 


e Basic operations 
e Basic things answering the general queries with ease 


e Basic questions 


The Role of Humans 


Conversational commerce is powered by humans. The UI developed is 
powered by humans. The structure (also called an interface) is designed by 
humans and is where the communication occurs. 

When a conversations increases in complexity, it is handed over for 


human operators to resolve. 
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Growth of Chat Apps 


The chatbot’s popularity comes from the growing use of messaging 
applications such as Facebook Messenger, WhatsApp, and Telegram. 
These chat apps are now trending and surpassing social applications. 
The Facebook Messenger platform is a good example of an application 
that has surpassed all social apps because of the following: 


e Aunified and a free flowing UI 
e Great experience 
e Very dynamic as many people use them 


Chatbot allows us to work on business criteria by having direct 
conversations with a company. 


The following sections provide some chatbot examples. 


Poncho 


Poncho is a weather activity bot whose logo is cat. The cat handles all the 
conversations for you and shares the weather in a simple and collaborative 


way. 


CNN Bot 


This is a news bot providing news options. We can ask specific questions to 
the bot with keywords such as "Space" It will then give us information about 
space news. The CNN bot also learns from our daily activity and predicts 
accordingly, with news options available based on the type of searches we do. 


Spider Bots 


Another common bot type is the web spider bot. These bots gather 
information from the web in order to discover details that can be 
harvested and stored. We can use these bots to capture e-mail 
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information from a page and move to the next page. This process is 
known as scraping. Search engines like Google use spiders to increase 
the speed of their searches. 


Twitter Bots 


There are bots present on Twitter that analyze tweets. They work on 
finding specific topics, intending to do retweets based on those topics. 


Botnets 


When a coordinated unit of bots works together in tandem, we call that a 
botnet. Botnets can be requested go to the same web page at once and make 
web sites crash. This is also known as a distributed denial-of-service (DDoS) 


attack when botnets are distributed. 


Reinforcement Learning Bot 


Reinforcement learning bots use a reinforcement learning approach. 
Reinforcement learning is based on trial-and-error. Reinforcement 
learning is also based on environments (It can be a 3d space, A game based 
scenario etc) and worlds, hence why we should not work on modeling the 
world. Instead we should work on modeling the mind that means the best 
possible step that needs to taken should be given to the machine such that 
it works within its limits. 

DeepMind (Its a Google funded startup that works towards finding 
reinforcement learning solutions to practice) worked toward finding a 
solution that is now popular and works toward formulation of artificial 
general intelligence. 

DeepMind's algorithm works toward solving solutions, such as playing 
Atari games with one unified approach, is known as Deep Q-Learning. It 
takes two inputs: the raw pixels of the game and the game score. Based 
on those two, it has to reach its objective to maximize the score. First it 
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uses deep convolutional neural networks to interpret the pixels. Deep 
convolutional neural networks extract features and the bot learns as 


hidden layers get incredibly abstract. 


The Structure of a Bot 


This section describes what a bot structure looks like and how 
conversations flows. 

Figure 1-13 describes how the structure of the bot's programming 
is formed. 


| 
HH 


Figure 1-13. The structure of the bot 


We first start with texting with some questions, then we move to the 
place/template where we start developing or coding the logic of the bot 
here the response flow is generated. Next, we describe the intent that 
forms the basis of the bot’s communication, in order to provide a textual 
response and making the chatbot interactive. 
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We use entities to break the piece of information that is message flow to 
better understand what is happening for our usage to communicate. Finally, 
we create a workflow for the bot to get organized. This flow which allows the 
entire process to work efficiently it is either called a dialog flow or form flow. 

Let's talk about the structure of bot in detail now. We generally want 
to see an efficient text response platform. For bots to work in a specific 
manner, we need a specific software development kit or interface where 
we start preparing the logic. The logic can be embedded within an IDE or it 
can be completely cloud based, as in IBM's Watson. 

We need to have a template, or place, where we start our development. 
Of course, it's easier to start with a template because the basis is already 
formed. 

Now we need to find specific ways to deal with a type of 
communication. For this, we use intent. Intent is generally the basis for 
the training of our bot. For example, if we have an intent for the bot to 
offer greetings, the ways for the bot to start with that intent might be “Hi,” 
“Hello,” "Hey there,’ and so forth. We have to provide specific text for 
understanding the logic of the intent. 

Now we move to something called entities. When a user has a text 
conversation with a bot, the bot uses intent to choose the response or to 
make intelligent decisions to get the conversation flow going. 


Dialog Flow or Form Flow 


This dialog flow, or form flow, s the process by which we structure the 
intents and entities to work together for a specific goal for the bot. We 
declare all the functionalities that will be performed by the bot. Now we 
are done with the logic, and this is how the bot is organized. 
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Bot Frameworks 


The technology giants have all come up with different bot frameworks to 
get started with bot development. Here are the major bot frameworks: 


e Microsoft has the Bot Framework. 
e Google has Wit.ai and Dialogflow. 
e IBM has Watson. 


e Amazon Web Services (AWS) has its own bot 
framework powered by AWS Lambda. 


e We can develop a chatbot by using TensorFlow. 
e We can also use FlockOS to develop chatbots. 


Chatbots are gaining in popularity. That's why every big company is 
trying to create a framework where bot development can occur. 

As we gather information with the flow of bots, we use a programming 
language to structure the bot and redirect it accordingly. 

We are seeing the rise of chatbots as the evolving bot frameworks are 


becoming readily available to use. 


Conclusion 


This chapter presented the basics of bot frameworks and described the 
process of developing bots. We also covered artificial intelligence with 
descriptions of machine learning as well as deep learning. We have shown 
how conversational commerce works and discussed the digital brain in 
terms of chatbots. Finally, we touched on the structure of bots and ended 
with the frameworks available for bot development. In the next chapter, we 


can begin bot development. 
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Microsoft Bot 
Framework 


This chapter covers the Microsoft Bot Framework. We will start with a brief 


introduction to the Microsoft Bot Framework. After that, we will move to: 
e The template for Bot Framework with Visual Studio 


e Begin working with the Bot Framework with Visual 
Studio 


e Talk about different Bot Framework states such as 
Intent, Entities for Bots and then describe dialogs and 


form flow 
e Language Understanding and Intelligent Service (LUIS). 


e The new LUIS web site, the changes, and explore and 
discuss its features 


e Developing an end-to-end bot using different bot 
properties 


e Publishing the bot 
e Using Dynamics CRM to use it in Bot Framework 


e Studying the structure of AI and bots. 


© Manisha Biswas 2018 
M. Biswas, Beginning AI Bot Frameworks, https://doi.org/10.1007/978-1-4842-3754-0 2 
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When we are working toward building connections that is the 
interactive nature of chatbots and a well-managed conversation flow, we 
aim to use frameworks that make the work easier for us. The Microsoft 
Bot Framework is an essential collection of tools and supportive software 
development kits (SDKs) for making the work easier when creating and 
deploying well-managed conversation bots. 


starting with the Prerequisites 


To use the Microsoft Bot Framework for development, we first need to 
satisfy some prerequisites. This section describes some of the things that 


are necessary in order to get started: 
e IDE: Visual Studio 
e Operating system: Windows 10 
e Bot development framework: Bot Builder 


e Emulator for testing: Bot Framework Emulator 


Visual Studio 


First, for the framework to work, we need an integrated development 
environment (IDE), a place where we can code the entire thing. Visual 
Studio is an essential choice for developing for Microsoft Bot Framework. 
It combines the use of Microsoft technology smoothly and it is aligned well 
with the Microsoft technology stack. In this book, we will work with Visual 
Studio 2015, but we could use Visual Studio 2017. You can download 
Visual Studio from https: //docs.microsoft.com/en-us/visualstudio/ 
install/install-visual-studio. 
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Windows 10 


We need to have an operating system in place for developing and hosting 
the IDE. The operating system of choice is Windows 10, and you can 
download it from www.microsoft.com/en-in/software-download/ 
windows10. Figure 2-1 shows the Windows 10 download page. 





Figure 2-1. The page to download Windows 10 


Bot Builder 


We also need to have a blueprint for our Bot Framework development 
with Visual Studio. We will have to download a template, and, yes, we will 
have to choose a programming language in which to develop our bot. The 
programming language of choice is Cz. We will be dealing with the same 
programming language most of the time during our bot development. 

You can download the template from https: //docs.microsoft.com/ 
en-us/bot - framework/bot-builder-overview-getstarted. Scroll down 
this page to find the template to download, as shown in Figure 2-2. 
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Visual Studia project templates 


Download Visual Studio project templates to accelerate bot development. 
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Figure 2-2. The link to download the Visual Studio template 


Bot Framework Emulator 


When we are done coding, we'll need to test the bot locally before hosting 
it. We'll use a bot emulator to test all the functionalities and the entire flow 
of the bot. You can download the Bot Framework Emulator from https : // 
docs .microsoft.com/en-us/bot-framework/debug-bots-emulator. 
Figure 2-3 shows the emulator's download page. 
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Figure 2-3. The emulator download page 


The main page hosts all the bot emulators. From that list, we can 
download and run the emulator's EXE file. The executable will create a 
shortcut on the desktop. You can then double-click that shortcut to get the 
emulator running. The direct link to get the EXE is https: //github.com/ 
Microsoft/BotFramework-Emulator/releases/tag/v3.5.34. 

Figure 2-4 shows the appropriate EXE to download. 
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Figure 2-4. The EXE file for the emulator 


Creating a Simple Bot Framework App 


In this section, you will create a simple bot framework app by using the 
VS template in the C# language. Then you'll test the app first by running it 
locally and then by using the Bot Framework Emulator. 


Using a Template to Create the Project 


To get started, you first have to start the Visual Studio IDE for development. 
When you open Visual Studio, the IDE screen looks like Figure 2-5. 
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Figure 2-5. The Visual Studio IDE screen when opened for the first 


time 


You need to open a new template to create a project. Click the File tab 


at the top left and then click New > Project, as shown in Figure 2-6. 
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Figure 2-6. Creating a new project 
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In the New Project window that opens, you will see that the 
downloaded Visual Studio template for C# is available for creating a bot. 
Within the templates for Visual C£, you can find the Bot Application 
template (see Figure 2-7). 
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Figure 2-7. The Bot Application template 


You are now ready to create an app from the template. In this example, 
you will use the template without changing any parameters so you can see 
what the Bot Application template does. 

First, you need to name the app. In this example, you will name 
it Appl. Then click OK to continue. In the back end, the template will 
formulate the bot framework essentials and create the necessary files to get 
your first bot application working. Let's run and observe the code created. 
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Working with the Code 


As the project file is created, you will focus on the Solution Explorer option, 
where you can see the hierarchy of the available files. Figure 2-8 shows the 


files created at the start of the project. 
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1 x! URL 
Figure 2-8. The available files for the new project 


http://localhost: 39 /9/ 
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In terms of getting everything right, the most important file is the web. 
config file. This is used for hosting the app on the Web with Azure as well 
as having the entire key details filled in correctly. It's an XML file in which 
you have to provide the details for the application ID as well as other 
details from the Bot Framework web site, which we will discuss later. 

Figure 2-9 shows the how the XML file looks when accessed in the IDE. 
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Figure 2-9. The web.config file in the IDE 
The entire web.config XML file has the structure shown in Listing 2-1. 


Listing 2-1. web.config file as XML Format 


<?xml version="1.0" encoding-"utf-8"?» 

ae 
For more information on how to configure your ASP.NET 
application, please visit 
http://go.microsoft.com/fwlink/?LinkId-301879 
--> 

<configuration> 
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«appSettings» 
<!-- update these with your BotId, Microsoft App Id and 
your Microsoft App Password--» 
«add key="BotId" value-"YourBotId" /» 
«add key="MicrosoftAppId" value="" /» 
«add key-"MicrosoftAppPassword" value="" /» 
«/appSettings» 
cies 
For a description of web.config changes see http:// 
go.microsoft.com/fwlink/?LinkId-235367. 


The following attributes can be set on the «httpRuntime» tag. 
«system.Web» 
«httpRuntime targetFramework-"4.6" /» 
«/system.Web» 
--> 
<system.web> 
«customErrors mode-"Off" /» 
«compilation debug-"true" targetFramework-"4.6" /» 
«httpRuntime targetFramework-"4.6" /» 
«/system.web» 
<system.webServer> 
<defaultDocument> 
<files> 
<clear /> 
<add value="default.htm" /> 
</files> 
</defaultDocument> 


<handlers> 
«remove name-"ExtensionlessUrlHandler-Integrated-4.0" /» 
«remove name-"OPTIONSVerbHandler" /» 


35 


CHAPTER 2 MICROSOFT BOT FRAMEWORK 


36 


«remove name-"TRACEVerbHandler" /» 

«add name="ExtensionlessUrlHandler-Integrated-4.0" 
path="*." verb="*" type="System.Web.Handlers. 
TransferRequestHandler" preCondition="integratedMode, 
runtimeVersionv4.0" /» 


</handlers></system.webServer> 
<runtime> 
<assemblyBinding xmlns="urn: schemas-microsoft-com:asm.v1"> 


<dependentAssembly> 
<assemblyIdentity name-"System.Web.Helpers" publicKey 
Tokenz"31bf3856ad364e35" /» 
«bindingRedirect oldVersion-"1.0.0.0-3.0.0.0" 
newVersion="3.0.0.0" /» 

</dependentAssembly> 

<dependentAssembly> 
<assemblyIdentity name-z"System.Web.Mvc" publicKeyToken- 
"31bf3856ad364e35" /» 
«bindingRedirect oldVersion-"1.0.0.0-5.2.3.0" 
newVersion="5.2.3.0" /» 

«/dependentAssembly» 

«dependentAssembly» 
<assemblyIdentity name-"System.Web.WebPages" publicKey 
Tokenz"31bf3856ad364e35" /» 
«bindingRedirect oldVersion-"1.0.0.0-3.0.0.0" 
newVersion="3.0.0.0" /» 

«/dependentAssembly» 

«dependentAssembly» 
«assemblyIdentity name-"Newtonsoft.Json" publicKeyToken 
-"30ad4fe6b2a6aeed" culture-"neutral" /» 
«bindingRedirect oldVersion-"0.0.0.0-8.0.0.0" 
newVersion-"8.0.0.0" /» 

«/dependentAssembly» 
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«dependentAssembly» 
«assemblyIdentity name-"System.Net.Http.Primitives" 
publicKeyToken-"bO3f5f7f11d50a3a" culture-"neutral"/» 
«bindingRedirect oldVersion-"0.0.0.0-4.2.29.0" 
newVersion-"4.2.29.0" /» 

«/dependentAssembly» 

«dependentAssembly» 
«assemblyIdentity name-"System.Net.Http.Formatting" 
publicKeyToken-"31bf3856ad364e35" culture-"neutral"/» 
«bindingRedirect oldVersion-"0.0.0.0-5.2.3.0" 
newVersion-"5.2.3.0" /» 

«/dependentAssembly» 

«/assemblyBinding» 
«/runtime»«/configuration» 


Figure 2-10 shows the most important part of the XML file, where we 
have to make changes. The Configuration tab is where we have to put in 
all the information. The appID, BotID and the AppPassword needs to be 
updated. 


--> 
j«configuration» 

<appSettings> 
<!-- update these with your BotId, Microsoft App Id and your Microsoft App Password--> 
<add keys"BotId" values"YourBotId" /> 
<add keys"MicrosoftAppId" value="" /> 
<add keys"MicrosoftAppPassword" value="" /> 

</appSettings> 


Figure 2-10. Code for the Confiuration tab 


Listing 2-2 shows how to get the BotId, MicrosoftAppId, and 
MicrosoftAppPassword values that need to be put in. 
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Listing 2-2. Important Code Section Providing Values from the bot 
Website 


«appSettings» 
<!-- update these with your BotId, Microsoft App Id and 
your Microsoft App Password--» 
«add key-"BotId" value-"YourBotId" /» 
«add key="MicrosoftAppId" value="" /» 
«add key-"MicrosoftAppPassword" value="" /» 
«/appSettings» 


You will get the details of the bot ID, Microsoft app ID, and the 
password from the Bot Framework web site. You will go through that 
process later in this chapter, when you publish the app. For now, let's 
concentrate on the coding logic. 

Inside the controllers folder, you will find the MessageController.cs 
file. The logic for the template works like this: The MessageController.cs 
file checks for activity and then scans any message sent to the bot. The file 
checks the string length and then returns the character size or message 
length. Listing 2-3 shows the process in C£ of checking the length of the 
characters. 


Listing 2-3. The Reply Message Code Block in C£ 


if (activity.Type -- ActivityTypes.Message) 
{ 
ConnectorClient connector = new 
ConnectorClient(new Uri(activity.ServiceUrl)); 
// calculate something for us to return 
int length = (activity.Text ?? string.Empty). 
Length; 
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// return our reply to the user 
Activity reply = activity.CreateReply($"You 
sent {activity.Text} which was {length} 
characters"); 
await connector.Conversations. 
ReplyToActivityAsync(reply); 

J 


The first line of code uses the Client connector. This connector 
establishes a channel to communicate via the bot messaging system. The 
next line checks for the string length of the message. Using the ?? operator 
provides two options: activity.Text ?? string.Empty. If we get a 
character of a certain length, the logic on the left is implemented. If the 
message is empty, the logic on the right is implemented. 

Listing 2-4 shows the complete MessageController.cs file. 


Listing 2-4. Entire Message Reply Code Block 


using System; 

using System.Ling; 

using System.Net; 

using System.Net.Http; 

using System.Threading.Tasks; 
using System.Web.Http; 

using System.Web.Http.Description; 
using Microsoft.Bot.Connector; 
using Newtonsoft.Json; 


namespace Bot Application1 


{ 
[ BotAuthentication | 


public class MessagesController : ApiController 


{ 
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/// «summary» 

/// POST: api/Messages 

/// Receive a message from a user and reply to it 

/// </summary> 

public async Task«HttpResponseMessage» Post([FromBody | 


Activity activity) 


if (activity.Type == ActivityTypes.Message) 


else 


ConnectorClient connector = new 
ConnectorClient(new Uri(activity.ServiceUrl)); 
// calculate something for us to return 

int length = (activity.Text ?? string.Empty). 
Length; 


// return our reply to the user 

Activity reply = activity.CreateReply($"You 
sent {activity.Text} which was {length} 
characters"); 

await connector.Conversations. 
ReplyToActivityAsync(reply); 


HandleSystemMessage(activity); 


var response - Request. 
CreateResponse(HttpStatusCode.OK); 
return response; 


{ 
{ 
} 
{ 
j 
} 
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private Activity HandleSystemMessage(Activity message) 


{ 
if (message.Type == ActivityTypes.DeleteUserData) 


{ 
// Implement user deletion here 
// If we handle user deletion, return a real 
message 
j 
else if (message.Type -- ActivityTypes. 
ConversationUpdate) 
{ 
// Handle conversation state changes, like 
members being added and removed 
// Use Activity.MembersAdded and Activity. 
MembersRemoved and Activity.Action for info 
// Not available in all channels 
j 
else if (message.Type -- ActivityTypes. 
ContactRelationUpdate) 


{ 
// Handle add/remove from contact lists 
// Activity.From + Activity.Action represent 
what happened 

j 


else if (message.Type -- ActivityTypes.Typing) 


{ 
// Handle knowing tha the user is typing 
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else if (message.Type -- ActivityTypes.Ping) 
{ 
j 


return null; 


Running the Application 


Now let's run the bot project. To run the project file, select the green Play 


button with the browser selected, as shown in Figure 2-11. 


DX] Bot Application - Microsoft Visual Studio 
File Edit View Project Build Debug Team  &Nsight Tools Architecture Test Analyze 
O- B-S MP - -| Debug ~ AnyCPU D Google Chrome ~ ©, ~ 

Figure 2-11. Running the project 


When you run the application, you will see that it opens locally in a 


web browser; see Figure 2-12. 


C 


Bot_Application1 


escribe your bot here and your terms of use et 
Visit Bot Framework to register if bot. When register it remember to set your bot's endpoint to 


ts h"ocgtTPomee/acgi^merttaget 


Figure 2-12. The bot running in the web browser 
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Take note of the localhost address. For testing purposes, you have to 
use this link. Now, let's start the emulator. Figure 2-13 shows the screen 
when the Bot Framework Emulator starts. 

















Figure 2-13. The Bot Framework Emulator screen 


You have to provide the endpoint URL or the localhost URL for the bot 
app. After providing the localhost address, and keeping the other options 
vacant, click the Connect button, as shown in Figure 2-14. 





Figure 2-14. Sharing the localhost address and then connecting 
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Testing the Application 


Now let's test the application. First, send a message of Hi there who are 
you. The reply message provides the number of characters, as shown in 
Figure 2-15. 


You sent Hi there who are you which was 20 characters 


Figure 2-15. The response for the message 


The bot code and the logic is a combination of three things, illustrated 


NNNM 


a 
ie 


The connector handles all communications. The activities are the 


in Figure 2-16. 











Figure 2-16. Bot code logic 


events that occur between a bot and a user. The messages are the messages 
that are displayed between a bot and a user. 
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Let's modify the code a bit. This time, in the activities section, you'll 
use Markdown content. So let's go back to the code. Keep everything in the 
activities section and add the code in Listing 2-5. 


Listing 2-5. Markdown Reply Format 


reply.TextFormat - "markdown"; 
reply.Text += ",this is a continued effort that we are making"; 
reply.Text += ", We are writing for Apress’; 


The update Activities code chunk looks like this. 
if (activity.Type -- ActivityTypes.Message) 


{ 
ConnectorClient connector = new 
ConnectorClient(new Uri(activity.ServiceUrl)); 
// calculate something for us to return 
int length = (activity.Text ?? string.Empty). 
Length; 
// return our reply to the user 
Activity reply = activity.CreateReply($"You 
sent {activity.Text} which was {length} 
characters"); 
reply.TextFormat = "markdown"; 
reply.Text += ",this is a continued effort that 
we are making"; 
reply.Text += ", We are writing for Apress’; 
await connector.Conversations. 
ReplyToActivityAsync(reply); 

J 


Let’s run this code and test it in the emulator. As you run the code in 
the emulator, you'll see that it prints the messages in Markdown format. 
The added text is also printed. Figure 2-17 shows the response. 
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You sent Hi Manisha here which was 15 characters this is a continued effort that we are making. We are writing for Apress 


Figure 2-17. The response after updating the code 


Managing State 


This section shows how to manage states in bots. When we have to manage 
complex communication, we need to have a kind of communication 
medium, or a place, to get the conversation going. Figure 2-18 shows 
options for managing states in bots. Table 2-1 explains each state. 





Figure 2-18. Ways of managing bots 
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Table 2-1. Managing States 

Managing State Description 

Storage methods We can save the state of a bot with the help of databases. 
We can save the data in SQL Server, Azure, and so forth. 


Class-specific logic | We can initiate a class at runtime and make the bot work. 
at runtime Then we can understand the logic as the bot evolves with 
different functionality for the lifetime of the bot. 


Form flow, or dialog If we want to initiate certain things sequentially, we need to 


flow implement form flow, or dialog processes. 
otate client This option is similar to viewing state or session states in 
.NET or MVCs. 


Understanding the Use of Dialogs 


Dialogs are the flow of conversation to provide a way to communicate a 
response by using messages in chained manner. 

When we are creating a bot, we are working in an efficient manner 
so that we get a response in proper way. More specifically, we are trying 
to receive the interaction which should be responsive. Therefore, we are 
working toward a quality experience of the bot conversation. Dialogs help 
us realize the perfect experience for the bot. 

Let's just work on the code concept for dialogs now. First, open Visual 
Studio and select the bot template again. Name it ManishaBot, as shown in 
Figure 2-19. 
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Mew Project ? X 
b Recent AMET Framework 45.2 = Sortby: Default . 8 i Search installed Templates (Ctrl E) A- 
34 installed m . 
X LL] Azure Mobile App Visual C= Type: Visual CS 
4 Templates Template to build a bot application for 
a Visual Cr [D Azure Mobile Service Visual C£ Microsoft Bot Framework 
b Windows 
ra 
Web T] Excel 2010 VSTO Workbook Visual Ce 
b Office SharePoint 
NET Core m] Outlook 2010 VSTO Add-in Visual CS 
Android 
[4] 
Cleud W Word 2010 VSTO Document Visual CF 
Cross-Platform 
Extensib:lity mat. — 
Actaty Library Visual Cz 
b iOS hl 
— ce 
LightSwitch Ge WCF Workflow Service Application Visual C£ 
Reporting 
Sabverleght Pi 
* Blank App (Android) Visual CE 
Test Nl PP 
P TOs . 
E Bot at Visual CE 
WCE Application sua! 
Workflow ga 
P. Visual Basie ES Class Library (Xamarin.Forms) Visual CR 
b Online 
Mame | 
Location: FAManishaBot - | Browse. | 
Solution: Create mew solution - 
Solution name: HanishaBot [v] Create directory for solution 


[ ] Create new Git repository 


cH 
Figure 2-19. Creating the dialog bot 


Within the directory structure of the project, you need to create a 
Dialogs folder. The process for creating the folder is shown in Figure 2-20: 
click Add > New Folder. 
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E Solution 'ManishaBot' (1 project) 
all ral Aanecha Pin 
bg Build 
b Rebuild 
P Clean 
b 
View 
p Analyze + 
Convert j 
^| &* Publish... 


Configure Azure AD Authentication... 
Scope to This 
E]! New Solution Explorer View 
5 Show on Code Map 
Area 


Mew ltem.. CtrleShift-A | Manage NuGet Packages... 


Existing Item... Shift+ Alt+A DR Set as StartUp Project 
New Seatfolded Iter... Debug + 


initialize Interactive with Project 


mt 





Add ASP.NET Folder t [OF ocpenFrameworks addons 


REST API Client... db Cut Ciri 
"y Applicaton Insights Telemetry... | Paste Ctrl+V 

New Azure Weblob Project x Remove Del 

Easting Project as Azure Weblob | O Rename 

Reference... Unload Project 

Service Reference... | C* Open Folder in File Explorer 
tp Connected Service... LB  Nsight User Properties 

Analyzer... J^ Properties Alt+Enter 

TypeScript File nabled False 

TypeScript J5X File DRL 

HTML Page | http://localhost:3879/ 

JavaScript File Authentication Disabled 

ei pedis ect File ManishaBot.csproj 

Web Form ect Folder F \Manitha bot Manishabot\Manes 
"he Class. 





Figure 2-20. Creating a folder named Dialogs 


Within the Dialogs folder, you will add one class file. Click Add > New 
Item, as shown in Figure 2-21. 
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> oa References 
> 9 App Start 
> € Controllers 












© View in Browser (Google Chrome) Ctile Shift- W z A 


Browse With cibal asax 
, kagei.config 
'eb.config 















© Controller EJ 
| New item... | Cirle Shifts A Scope to This 
Shift- Akt- A By New Solution Explores View 
New Scaffoided Item... A Show on Code Map 
1a New Folder Exclude From Project 
Add ASP NET Folder ^" [X cut Conte X 
REST API Client (B Copy Chl C 


New Azure Weblob Project 










Existing Project as Azure Weblob X Delete Del 

- ] Q 

typescript File O Rename 

TypeScript JSX File Q^ Open Folder in File Explorer 

HTML Page JP Properties Alt- Enter 

JavaScript File zu ne learn Explorer Class View 
Style Sheet Properbes 








Web Form 


Dialogs Folder Properties 

EIE 

B Mx 

Folder Name Dialogs 





Class 


Figure 2-21. Adding a new item. From the Visual Studio we select a 
new item and then add a class file. 


Now you will add a class file. The process, as shown in Figure 2-22. 
Name the class file RandomFactDialog.cs. 


Add New item - ManishaBot T x 
Search Installed Templates (Ci E) A= 
Visual Ca * Types | Type went to sesch fer 
An empty class declaration 


Forma Blank Content Page Mard Visual Cg 
im» 


D Fermi Blank Content Page Xami Visual C£ 
ima 

hj Ferm Blank ContentPage Visual C2 
E. j Forme Blank ContentPage Visual C= 


I3 Forme Carousel Page Hand Visual CF 

Miei I5 Forme Carousel Page Karel Visual CE 

i I Forma Content Page Hamil Visual Ca 

"ect cf Ferms Conbee or Visual Cz 
Sehagringht 

SL ei Li Fermi ConbesitV one Vrsual CE 

E D Forrai Listen Page Maral Vrsual C£ 


b Ohne 


[3 Forme Listino Page Xamil Visual C= 
cm} 


Im sa mod o4 "m 


Cirk here to go onbre and Find templates 





Figure 2-22. Creating a class. Here we are creating a separate class so 
that we can formulate the logic in here. 
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Next you'll link the message controller to the dialog class you created; 


see Listing 2-6. 


Listing 2-6. Referencing the RandomFactDialog Class File 


if (activity.Type -- ActivityTypes.Message) 


j 


{ 


ConnectorClient connector = new 
ConnectorClient(new Uri(activity.ServiceUrl)); 
// calculate something for us to return 

// int length = (activity.Text ?? string. 
Empty).Length; 


// return our reply to the user 

// Activity reply - activity.CreateReply($"You 
sent {activity.Text} which was {length} 
characters"); 

//await connector.Conversations. 
ReplyToActivityAsync(reply) ; 

await Conversation.SendAsync(activity, () => 
Dialogs.RandomFactDialog.Dialog) ; 


The most important part being this piece of code where we link 


it to the Dialog class we created. 


await Conversation.SendAsync(activity, () => Dialogs. 


RandomFactDialog.Dialog) ; 


Now the RandomFactDialog class file where you implement chaining 


for messages looks like Listing 2-7. 
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Listing 2-7. Chaining Messages 


using System; 

using System.Collections.Generic; 
using System.Ling; 

using System.Web; 

using Microsoft.Bot.Builder.Dialogs; 


namespace ManishaBot.Dialogs 


{ 
[Serializable] 
public class RandomFactDialog 
{ 
public static readonly IDialog<object> Dialog = Chain 
.PostToChain() 
.Select(m => "The fact is,you said **" + m.Text + "**") 
.PostToUser(); 
} 
J 


Let’s run the code and see what exactly happens. Type hi. With the 
dialog chaining, the response is available in the bot, as you can see in 
Figure 2-23. 


The fact is you said hi 


Ae] Type 


Figure 2-23. The response for the bot 
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Now you will develop a more complex dialog chaining. Listing 2-8 
shows the changes in the structure of the dialog chaining. 


Listing 2-8. Chaining a Series of Messages 


public static readonly IDialog«object» Dialog - Chain 
.PostToChain() 
.Select(m -» m.Text) 
«Switch 
( 


Chain.Case 


( 


new Regex("^tell me a fact"), 
(context, text) => 


Chain.Return("Grabbing a fact...") 
.PostToUser() 
.ContinueWith«string, string»(async (ctx, res) => 


{ 


var response = await res; 


// var fact = await Helpers.GeneralHelper. 
GetRandomFactAsync(); 


return Chain.Return("**FACT:** *" +"** We 
are working on a fact that we are writing 
for Apress**" + "*"); 


}) 


53 


CHAPTER 2 MICROSOFT BOT FRAMEWORK 


), 
Chain.Default«string, IDialog«string»»( 


(context, text) -» 
Chain.Return("Say 'tell me a fact'") 
) 
.Unwrap() .PostToUser(); 


Listing 2-9 provides the class file in its entirety. 


Listing 2-9. The Class File Showing the Entire Chaining Process 


using System; 

using System.Collections.Generic; 
using System.Ling; 

using System.Web; 

using Microsoft.Bot.Builder.Dialogs; 
using System.Text.RegularExpressions; 
using System.Threading.Tasks; 


namespace ManishaBot.Dialogs 


| 

[Serializable | 

public class RandomFactDialog 

{ 

public static readonly IDialog<object> Dialog = Chain 
.PostToChain() 

.Select(m -» m.Text) 
.Switch 
( 
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Chain.Case 


( 


new Regex("^tell me a fact"), 
(context, text) -» 


Chain.Return("Grabbing a fact...") 
.PostToUser() 
.ContinueWith«string, string»(async (ctx, res) => 


{ 


var response = await res; 


// var fact = await Helpers.GeneralHelper. 
GetRandomFactAsync() ; 


return Chain.Return("**FACT:** *" +"** We 
are working on a fact that we are writing 
for Apress**" + "*"); 


}) 


), 
Chain.Default«string, IDialog«string»»( 


(context, text) -» 
Chain.Return("Say 'tell me a fact'") 
) 
.Unwrap() .PostToUser(); 


public static Task Helpers { get; private set; } 
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If you run the code now, you will get the result shown in Figure 2-24. 


Say "teli me a fact 


Grabbing a fact... 


FACT; *** We are working on à fact that we are writing for Apress** 


Figure 2-24. Working on a complex chaining process 


You start the conversation with hi. The bot responds with Say ‘tell me 
a fact’. When you type tell me a fact, the bot gets inside the chaining logic 


and pops up a message. 


Publishing the Bot to the Cloud by Using 
Azure 


In order to publish the bot to the cloud, you first need to register the bot. 
You do that by heading to https: //dev.botframework.com/. 
The Bot Framework page is shown in Figure 2-25. 
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Build a great 
conversationalist. 


Smart bots start here. 


Figure 2-25. The Bot Framework page 


At the top of the page, click the My Bots link, as shown in Figure 2-26. 


Bot Framework My bots Documentation Blog 


This site uses cookies for analytics, personalized content and ads. By continuing to br 





Figure 2-26. My Bots option 


From the My Bots page, click the Create a Bot button, shown in 
Figure 2-27. 





Figure 2-27. The Create a Bot option 
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On the next page, click the Create button, shown in Figure 2-28. 


Create a bot or skill. 


Build a bot using the Bot Builder SOK and optionally provision your bot in Microsoft 
Azure. 





© 


Create a bot with the Bot Builder SDK 


Click create below to use the SDK to build your bot and optionally hast it in Microsoft Azure. 


Figure 2-28. Creating a bot 


Click the radio button labeled Register an Existing Bot Using Bot 
Builder SDK, shown in Figure 2-29. Then click the OK button. 
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Create an SDK bot 


() Create a new SDK bot hosted in Microsoft Azure 


@ Register an existing bot built using Bot Builder SDK. 


Cancel 





Figure 2-29. Selecting the Bot Builder option 


Next, provide the details for the bot, as shown in Figure 2-30. 





Tell us about your bot 


Bot profile 


lean 
Uplcad custcm boon 


Configuration 


hha ean 


Figure 2-30. Providing details about the bot 
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After you provide the details for the bot, you need to generate an 
application ID and password. Click the option to Create Microsoft App ID 
and Password, as shown in Figure 2-31. 


Configuration 











Analvties 


Figure 2-31. Generating App ID and password 


In the next window, your application ID is displayed, as shown in 
Figure 2-32. 





Generate App ID and password 


Marishabol 


Figure 2-32. You have the app ID 
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Click the Generate an App Password to Continue button. Type in the 
application ID, password, and bot handle in the web. config file. The new 


password is generated, as shown in Figure 2-33. 


'ork.com962fbots962 fnews /quickstart/skypebot?appNamez ManishaBoT&ruzhttps:?e62F9?e2 Fdev.botframework.cc 


New password generated 


Copy this password now, this is the only time when it will 
be displayed. Please store it securely and paste it into your 


bot configuration file. 





Figure 2-33. The new password is generated 


To publish the bot from Visual Studio, right-click it to access the 
Publish option, as shown in Figure 2-34. 
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Build 
Rebuild 
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Figure 2-34. Preparing for publishing 
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The App Service screen opens, as shown in Figure 2-35. Click the New 


button for the Azure service. 
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Figure 2-35. Click the New button 


The bot is ready to be published. You will validate the connection and 


publish, as shown in Figure 2-36. 
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crosoft App Password--» 
















da755 Publish 
& Publish 
Profile ManishaBot20171208044925 - Web Deploy 





Publish method: Web Deploy ¥ 
Settings 
Preview 

Server: manishabot20171208044925.scm.azurewebsites.net:443 

Site name ManishaBotz0171208024925 

User name: SManishaBatz0171208044575 

Password: SPSS 


(M Save password 


Destination URL: | http://manishabot2017120804492 5. azurewebsites.net 


Validate Connection | Lo 





Figure 2-36. Validating and publishing the bot 


After the bot is published, you need to edit the configuration in the Bot 
Framework portal. Figure 2-37 shows how the Azure web page looks. 


C | © manishabot20171203044925. azurewebsites.net 


ManishaBot 


Describe your bot here and your terms af use etc. 


Visit Bot Framework to register your bot. When you register it, remember to set your bot's endpoint to 


https://yeour bats hosztnonc/api/messages 


Figure 2-37. The bot is published in Azure 
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Now head back to the Bot Framework portal. You need to edit the 
message endpoint for the bot. It will be the Azure web site followed by 
/api/messages. See the underlined section in Figure 2-38. 


Bot profile 


Icon 
Upload custom icon 


ManishaBoT 
Just for testing 


Configuration 


http//manishabot201 71208044925 azurewebsites.net/api messages 


Figure 2-38. Adding the details in the configuration option 


The bot is now ready and in the cloud. 


Conclusion 


This chapter presented the Microsoft Bot Framework so that you could 
learn about its fundamentals, and publish a bot to the cloud. 

You learned about the Bot Framework template and created an 
example that could recognize the characters sent to the bot. You saw how 


to reference a class file in the main bot framework logic. Next, you learned 
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how to log in to the Bot Framework web site to generate the application ID 
and password needed for your web. config file. Finally, you learned how to 
publish the bot from Visual Studio to Azure Cloud. 

This first introduction forms the basis of how a bot framework works. 


In the next chapter, you'll learn about new bots from other organizations. 
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Wit.ai and Dialogflow 


This chapter covers the basics of Wit.ai and Dialogflow, two chatbot 
interfaces from Google that provide helpful capabilities. You'll start by 
exploring a simple bot flow using Wit.ai, and then move on to Dialogflow 
to create a full-fledged bot to deploy to the Web. 


Getting Started with Wit.ai 


Wit.ai is a web-based IDE for creating bots. To launch Wit.ai, you have to 
go to https: //wit.ai/. 

In this section, you'll work on creating a new app and then you'll add 
intent to it. Next, you'll add text and keywords to modify the bot. Later in 
this chapter, you'll implement the Dialogflow tools to implement the bot. 


Creating a New App 


In this section, you will work on creating your first app. From the Wit.ai 
web site, click Quick Start, as shown in Figure 3-1. 
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Figure 3-1. Choosing the Quick Start option to create an app 


This opens a page that presents options to create the first app by using 


either GitHub or Facebook, as shown in Figure 3-2. 


A Dock Hone 
LI Build your first app 


1 Rocipoa 
E Quicketart Lett pratand we wan Bud as app cr bec than Can Conbel Ine mpi ne of veu: cita 
e. HTTP AP 

O Node js e Sign up with GitHub or Facebook 
(à Python 


Gene Wit ai heme page end san nove yout Hub ec F'acebsox inea 
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Figure 3-2. Logging in using GitHub 
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After you log in, you'll have the option to create your new app, as 
shown in Figure 3-3. 


e ^e M Vae x y ee o x0 RF Mh ny » Aw x 0 5 x 
€ Q | à Soe | Phys rar &a $e! 


2 * 
wit.ai & Mee QU tee 


My Apps 





Figure 3-3. Creating a new app 


Let's create a simple app. You'll name the app TestStories. In the app 
description section, type Demo. Select the Private option for the app data. 
Then click the Create App button, shown in Figure 3-4. 


Create a new App 


x ^ wt be open O be communty 


Praw 





Figure 3-4. Setting the details for your new app 
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Adding Intent 


Clicking the Create App button opens the next page, which presents the 
Stories option. Following that, you head to the Understanding option; this 


page is shown in Figure 3-5. 


wit.ai 


lesb5iones ^o* E emri inbox 


Hello, 


Wielones ko yom rese Wd ap! 

Vil alice: you Io exc rac node pico of nlrieon — of entities — iom wh 
your users might pay bo your app. 

Tà get Started and inmate & rew enlity you can sbart }eeching yow app with ths ppu 
bakya, ior meler io cur documents 





Test how yaur app understands a sentence 


oe Dan LU NOH. aop Ds! King DTE deacon 


© Aid a pew ciy 


Yow app uses 1 entity 
Ew Derorguos vales 


intent Lon-catoadi arity 


os PN 
Figure 3-5. The Understanding options at the Wit.ai site 


Let’s work through the new app with a pizza example. 
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In the User Says text box, type I want some cheese pizza, as shown in 
Figure 3-6. 


Test how your app understands a sentence 


You can train your app by adding mope"examples 





| want some cheese pizza 


CIE ME CUR 
© Add anew entity 


Your app uses 1 entity 


Entity Description Values 


intent User-defined antiy 


LOOKUP STRATEGIES 


Figure 3-6. Adding details we are working towards ordering pizza so 
we are constructing the way to start the conversation 


Now you're ready to create an intent. You add the value for the intent 
as pizza, as shown in Figure 3-7. 


Test how your app understands a sentence 


You can train your app by adding more examples 


| want some cheese pizza e 
© Add a new entity Q pizzal t 
(v Validate Create new value "pizza" 


Your app uses 1 entity 


Entity Description Values 
intent User-defined entity 
LOOKUP STRATEGIES (iir: 


Figure 3-7. Creating a new intent. An intent is needed in here so that 
while conversation it is able to find the right order for communication. 
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You add a pizza option with cheese and finally click the Validate 
button, as shown in Figure 3-8. 


Test how your app understands a sentence 


You can train your app by adding more examples 


| want some cheese pizza 


intent Create new value "pizza" ¥ t 


pizza Create new value "cheese" - —— 


© Add a new entity 


[mum | 


Figure 3-8. Creating an intent and then validating it. We are creating 
different intent so that we are giving an option to choose for the user 
which type of pizza they want to have. 


After validating that is creation of the entities option, you have two 
entities created now, highlighted in Figure 3-9. 


Test how your app understands a sentence 


You can train your app by adding more examples 


Entity Description Values 
dm "tent User-detned entity pizza 


LOOKUP STRATEGIES C 


pizza User-detned entity cherse 


LOOKUP STRATEGIES oca EN Tori 





Figure 3-9. The app shows two intents 
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Adding Text and Keywords 


Let's work on modifying the bot. We will work now on creating the flow of 
the chatbot so the user is able to order different kind of pizzas. 

In this section, you'll try to add a sentence. Figure 3-10 shows how to 
add a sentence for recognition. 


Test how your app understands a sentence 


‘You can train your app by adding more examples 


| want to order cheese pizza o 
intent pizza = 
pizza cheese T 

© Add 


ad a new entry 


Figure 3-10. The app is trying to understand a sentence. Here we are 
working on how a chatbot will be able to discover what user is typing 
so that the sentence that is created is understandable to the bot. 


Next, click Validate. Now you need to select an entity. Choose Pizza 
and click the arrow associated with it (see Figure 3-11). 


Your app uses 2 entities 


Entity Description Values 
intent | > Us er-2e^rec ett para 
LOOK ES c 

pizza +“ User-deined entity cheese 





Figure 3-11. Select an entity and the arrow associated with it 
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When you click the Pizza arrow, you head to the page that has 


keywords and synonyms, as shown in Figure 3-12. 


pizza 


free-text keywords User-dained entity 





LOOKUP STRATEGIES @ trait free-text & keywords 


insights e 


"ali m risigl ity [a] 
Keywords 
Keyword © Synonyms € 
cheese © Add synonym 
Q Add a new keyword *t- 
Expressions  Filerby All values - 
Bh Search through your expressions 
Text 
66 — | want to order cheese pizza x 
&& | want some cheese pizza x 
E See More 


Figure 3-12. Page for adding a new keyword 
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Here you'll add new keywords. The results are shown in Figure 3-13. 


pizza 


LOOKUP STRATEGIES @ trait 





free-text keywords User-defined entity 


Insights e 


Keywords 


Keyword @ Synonyms © 
174 eo Add Ww ET 
Ge Dd Wem 


d t Wars o Add synonyn 
e" PoDOrON Q Add synonym 
Q Add a new keyword 


Figure 3-13. Added keywords so that we are exactly creating the 
ways different type of pizzas are ordered 


Now click the Understanding option in order to train the bot to 


recognize the new keywords that you added. It is visible at the bottom. 


Let's start with pepperoni pizza. For understanding the flow of the 
intent for pepperoni pizza, type in I want a pepperoni pizza, we are 


showing how the bot can be made to order a specific pizza as shown in 


Figure 3-14. Then click Validate. 


Test how your app understands a sentence 


You Can train your app Dy adding more examples 


| want some pepperoni pizza 
intent pizza d 


pizza pepperoni - 


Figure 3-14. Adding the pepperoni pizza option 
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Now you'll add veggie pizza, as shown in Figure 3-15. 


Test how your app understands a sentence 


You can train vour app by adding more examples 


veggie pizzal o 
intent pizza - 
pizza vege x 


Q Add a new enlily 


Figure 3-15. Adding veggie pizza option 


Let's now add a Large pizza option. For that, you need to make some 
changes, shown in Figure 3-16. 


Test how your app understands a sentence 


You can train your app by adding more examples 


Large pizza : 
intent M . 
pizza att Create new value "Large" e 

© Add a new entity 


Figure 3-16. You need to change the pizza option 


Delete the Pizza option, because you want to work on the size of the pizza. 
Click the cross option to delete the pizza value, as shown in Figure 3-17. 


Test how your app understands a sentence 


You can train your app by adding more examples 


Large pizza o 
intent pizza T 
x pirra Create new value "Large" * 
Q Add a new entity 


Figure 3-17. Deleting the pizza option 
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Creating a New Entity 


In this section, you'll create an entity named pizzaSize, shown in Figure 3-18. 


Test how your app understands a sentence 


You can train your app Oy adding more examples 


Large pizza o 
intent pazza X 
CD © pzzaSae 
| Press Enter < lo create a new entity calec pizza Size 


Your app uses 2 entities 


Figure 3-18. Creating the pizzaSize entity 


After creating the intent, the bot page looks like Figure 3-19. 


Test how your app understands a sentence 


You can train your app by adding more examples 


Large pizza o 
intent pizza - 
pizza Size Create new value "Large" id 


Q Add anew entity 


Your app uses 3 entities 


Entity Description Values 
intent User-defined entity pizza 


LOOKUP STRATEGIES ØE 
pizzaSize User-defined entity 


pizza User-defined entity vege, cheese, meal lovers, pepperoni 


LOOKUP STRATEGIES MISCO sine 





Figure 3-19. Adding a new intent 
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Implementing Wit.ai with Facebook 


You've gone through the process of creating a simple app that uses some 
ofthe features of Wit.ai. In this section, you'll implement Wit.ai with 
Facebook. The Facebook API is available at developers.facebook.com. 
You will create a chatbot for the official Facebook page, or any Facebook 
page. This chatbot will add to Facebook Messenger. You will have to set up 
webhooks accordingly. To get webhooks working, you need to set up ngrock. 
First, create a new app as you've done before. This time, name it Test], 


as shown in Figure 3-20. 


€ (Q | & Secure | Nipr/"weaijar “ev 
* * 
wit.al 


Create a new App 





Figure 3-20. Adding a new name 


Now head back to the Facebook for Developers site at https: // 
developers.facebook.com/. You need to use your Facebook credentials to 
log in. The page looks Figure 3-21. 
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E > C | d Secure | Pri psc developers facebook com 


facebook for developers f — Procuets Gece Took &Soppert Mews widest Sainn a My Sap 


Connect on a global scale. 


Build, grow and monetize your apps with Internet.org 





Figure 3-21. The Facebook for Developers page 


Now you need to create a new app. Click the My Apps option at the top 
right to access the drop-down menu for creating a new app, as shown in 
Figure 3-22. 


Search q My Apps ¥ 


EJ SampleApp 


Requests 





Developer Settings 
Company Settings 


Log Out of Facebook 





Figure 3-22. Adding a new app 
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Name it SampleApp and add a product to it by clicking the Add a 


Product button, as shown in Figure 3-23. 


SampleApp 


App ID: 355813871173924 
Status: @ Live 





Add a Product 





Figure 3-23. Adding a sample app 


For a product, you need to add a messenger, shown in Figure 3-24. 





+ 
^ Add a Product 


Acccust Ki Facebook Logis Aaciece Network 


mee 
DAENS MLAN CFI NS 0» penetra Tw vett nont 9n MC ege prend kon J mien f tcefboos edvetsers 


£45c Docs ber do Rass Coce fet ly Ress Doce bat Wp 


Massenge’ 


Costomce Fw wey res rónac if^ peade 2n 
Mato 





Marketing APT App Center Web Payments 


riegnale f'acebech Varbeteg AP wih yor 239 — — car dnm _ " m —— , 


Figure 3-24. Selecting the Messenger option 
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Click the Set Up button in the Messenger option. You will be using Wit. 
ai's natural language processing (NLP) rather than Facebook's (which is very 
basic), although both of them work perfectly together. Now you have to set 
up a page with the app name created; xxxxxx, as shown in Figure 3-25. Your 


goal is to create a chatbot for the official Facebook page. 


Token Generation 


Page token is required to start using the APIS. This page token will have all messenger permissions even if your app is not approved to use them 
yel Trough im this case you will be able io message only app admins. You can also generale page tokens for ihe pages you don't own using 
Facebook Login 


Page Page Access Token 


You must select a Page to generate an access token 


JJ Selecta Page 
Madam Coda 


Farab'e'iem Modam Coca 





Geck Monkey Studios Setup Weblicoks 
Windows & My Way of discovering It 


To receive messages and other events sent by Messenger users, the app should enable 
webhooks integration 


Figure 3-25. Selecting a web page in Facebook 


The site will ask for authentication, and then the token will be created. 
Now you need to quickly set up webhooks. Click the Setup Webhooks 


button, shown in Figure 3-26. 


Webhooks Setup Webhiooks 


To recelve messages and other events sent by Messenger users, the app should enable 
wenbhooks integration. 


Figure 3-26. Setting up Webhooks 


Clicking this option opens a page for assigning details. Before using 
webhooks, you need to configure ngrock. Go to the ngrock site at 
https: //ngrok.com/, shown in Figure 3-27. 
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ngrok HOWITWORKS PRICING — DOWNLOAD — DOCS 


Secure tunnels to localhost 


"I want to expose a local server behind a NAT or Firewall to the internet.” 


Sign Wp hor free = 





or Statt by dovemlogding ngrok 


Demo without deploying 


Don't constantly redeploy your In-progress work Eo get Feedback from 
clients. mgrok creates a secure public URL (https; yourapp.rereicia] to 
a local welurver a yout machine, karate quickly with imenediane 


Feedback without interrupting Flow, 


Simplify mobile device testing 


Test mobile appa against a development backend running on your 
machine. Point egrok at your local dev server and then comfigure your 
app be wie the njeok UAL Br womit change, even when yia change 


Petueütks. 





Figure 3-27. The ngrok site 


Download ngrock by clicking the Downloading Ngrok link to access 


the download options, shown in Figure 3-28. 


= D |ù iays | etter grok coer 


ngrok HWT WORES = PRKJNC DOWMLOAD — DOCR 


Download ngrok 


kk 


ngrok is easy to imstall. Download a single binary with zere run-tume 


dependencies For ary major platform. 





Lh Dp) madera [14-5 Limo DAR) Banca zd — KeerB 5D Keei- Di 
Erena [12 b 


Unzip Eo install 


Dë Lips oc OX pau tan ualip ayok Froos a cereal wh Len follewing cota, O3 
raiki 


Windpap lust deusis click 


sic people vet n allen for agrak clone: tin ihel ver Peida for arty access in ihe 


Figure 3-28. Downloading ngrok for Windows 
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After downloading ngrock, launch ngrok.exe from the command 
prompt. You have to open the command prompt and head to the localhost 
page. At my end, the localhost was 4040. Key in the following details at the 


command prompt: 
F:\ngrock>ngrok.exe http -host-header-rewrite localhost:4040 


If web server that is ngrock is up, you will see the window in Figure 3-29. 


BF Select Command Prompt - ngrok.exe http -host-headerz rewrite localhosb4040 = a A 
grok by Binconshreveable (Ctel4c to quit) 


online 

i.2.8 

United States (us) 

http: //127.0.8.1:4840 
http://7c9cc892.ngrok.io -> localhost:48480 
https://7c9cc892.ngrok.io -> localhost:4848 


onnections ttl opn rti rt& psa pre 
Es a 8.868 ü. Gò 8.88 @. oe 





Figure 3-29. The ngrok status 


Let’s head to the localhost page, shown in Figure 3-30, at 
http://7c9cc892.ngrok.io/inspect/http. 


(D 59035524 ngrokas piryt 





Figure 3-30. The inspect page as reflected that carries the 
information of the localhost page 
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When the page is up, you can see the statistics in the command- 
prompt window, as shown in Figure 3-31. 


E Command Prompt - ngrakexe http -host-haadarz rewrite localhost) = Oo X 
grok by @inconshreveable {Ctrl+C to quit) 


session Status 
‘ersion í 
Region United States (us) 


b Interface http://127.80,.,0.1:4040 
Forwarding http://7c9cc892.ngrok.io -> localhost:4848 
Forwarding https://7c9cc892.ngrok.io -> localhost:4648 


onnections ttl opn rti rts. poe pee 
a a 8.89 B. 82 434.38 438.18 


TTP Requests 


ET /static/js/compiled/shared.js 

BET /static/js/vendor/baseb4.]s 

3ET /static/js/vendor/react-15.1.8.min.js 

ET /static/js/vendar/moment-2.7.8.1js 

ET /static/js/vendor/underscore-1.6.8.min.]js 
BET /static/js/vendor/jquery-2.1.1.min.js 

BET /static/js/vendor/vkbeautify.js 

ET /static/css/bootstrap.min.css 

BET /static/css/ngrok.css 

BET /static/js/vendor/highlight-8B.1.min.js 





Figure 3-31. You have set up the ngrok environment 


Deploying the Wit.ai bot is easy after you've set up the ngrok 
environment as well as the webhook's natural language processing 
section. Next you will work with Dialogflow to create a complete bot that's 
deployable to the Web. 


Working with Dialogflow 


In this section, you'll use Dialogflow (formerly Api.ai) to create a bot. First 
you'll access the web console through your Google account. Then you'll 
create a Pizza bot. Finally, you'll use Small Talk to xxxxx and then link 
the bot to a Google project. A small talk is a way to access prebuilt API for 
doing the conversation in a proper manner. 

Let's start now. 
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Accessing Dialogflow 


This section introduces you to Dialogflow and gets you logged in via your 


Google account. 
Head to the Dialogflow web site at https: //dialogflow.com/. 


The Dialogflow web site for creating chatbots is shown in Figure 3-32. 


€ - O feo | TENERE 
EDT ue cm A -— 
—, 
Build natural and rich `Z 
conversational experiences M ~I 
Gud umare mea wayt 30 interact with your peceduct by building engaging roco and Sevi-oesed ^ 
casrmec s anion ad interfaces pirre Duy Al Conn lh iat om the Dougie Aalbers 


agigi, and other popar plattorms and devices 


Figure 3-32. The Dialogflow web site 


From this Dialogflow page, you can either sign up for free or, if you 
already have an account, you can to the console. If you have a Google 
account, you need to verify it and log in, as shown in Figure 3-33. 


B feces | hiph concole ogwr com sp chen gir 


Dialogflow 





Sign in with Already have non-Goegle Dialagflow 
- account? 


BESTU-E ALESE 





Figure 3-33. Logging in using a Google account 
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Allow the access, as shown in Figure 3-34. 


Google 


Dialogflow wants to 


e. View and manage your Google Assistant 
voice commands, dialog and grammar 


@; view and manage your Actions on Google. © 


Allow Dialogflow to do this? 


rou may review this apps terms of service and privacy policies. You 
Can femove tiis of att Other app WIT access TO Y Our account Im 
My Account 


Figure 3-34. Allow Dialogflow to access Goggle Assistant 


The next page is a Welcome screen. The apps in Dialogflow are known 
as agents. You will have to create one by clicking Create Agent, as shown in 
Figure 3-35. 


86 


CHAPTER 3 WIT.AI AND DIALOGFLOW 


*- e W Secure | hipi tonad om sp. —rer d 
E Dialogflow 3 Welcome to Dialogfow! 
Croate Agent 


» Dee 
^ Forum : z E 
Don't know where to begin? Let us help you get started. 
e sha 
Acto ater 
Legs 





SUNS OR 


Figure 3-35. The Dialogflow welcome page after loogging in 


Creating the Pizza Bot 


In this section, you will use Dialogflow to create a simple pizza bot. Name 
it PizzaBot, as shown in Figure 3-36. 





€ C | ters hit gris Sar dad ee eem fari ibe rir rv 
bed Dhalogflow PizzaBot | 
DEFAULT LAN tap DEFAULT TIME EDP 
naa m i aang 
> Form i iat 
(D Spat 
[2| Amari 
D) Logo 


p Gogia v2 Am es 
za Finga ey eb AT mn 


Figure 3-36. Creating a pizza bot 


Now you need to figure out what you need to do with the app. 
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Using Small Talk 


You will be using Small Talk for the bot's interactions. You'll use Small Talk 
for interactions like Hi, Hello, and so forth. Then you'll allow users to order 
the pizza. Dialogflow has this wonderful built-in API that does all the small 


talk for us. You just need to enable it, as shown in Figure 3-37. 
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You then import Small Talk accordingly. 


Linking to a Google Project 


In this section, you'll see how to integrate your bot with a Google project. 
You can link to a Google Project or create a new one, as shown in 
Figure 3-38. 


Link to Google Project 


Please, choose google project to link with new agent, or leave empty to create a new one 


Create a new Google project - 


Enables Cloud functions, Actions on Google and permissions management 


CANCEL 





Figure 3-38. Linking to a Google project 


After linking to a Google project or naming a new one, enable Small 
Talk for the PizzaBot app, as shown in Figure 3-39. Small Talk will help 
us immensely. Small Talk has all the basic conversation flows for us and 


makes us easier to communicate. 
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&- c ü doc hittpr//cangledalegficw com, spi clan? age toes tle -ba be de zd Tb rm a 


bed Dialogflow tj! Small Talk 


Parra Bet = T 
Es IET 


Crewe raw ages 


= ew Magen 


Can learn haw 12 support small tall wetoest any extra destionment Sy delak, R eil respond wah onedefined phrases. Uses Eve form below In custormx nespaenes bo Ee mari 


arr you) 


ri 
"amet: Wénedar?al B4 Bleéyi. Tisi Tor snrking. 


User: "re'rz ra maget- 
Mant: Thaskz! Tua dealing iz motus. 


CEU ERN] n [pe ] € “| 
| 


Integrations. Small Tak Customization Progress 
Ba] aio About agent = = üh 
k Fuime 
[] Courtesy - m nm 
Piba graii 





* Dx 
> Foun | 
D) Support 
ADOOUN 
^y Logai l 


Emotions : 1 Oo 
Hella Goodbye . tO OS 
About user z z D 
Confirmation E : ite 


Figure 3-39. Enabling Small Talk and saving it 


In the next step, you need to create a new entity for the app. 


Adding an Intent 


Now you will create an intent. now one of the thongs user might think of as 


parameter being hungry. So you will add an intent named Hungry. We will 


to create a new intent, as shown in Figure 3-40. 


c Œ ü Secure | Spi eor hod ab Ro som "aci nns 


aga debe5i3-Dp5-3e&«. bd 15- ace o6 T H b Fa eme cit 


ld Dialogflow [3] intents 


PirnaBoy = Jd 


* 


ry, Comite 

En Trang aria! 
[3 integrations 
Anadyties | 


b — Fehen 


E] Pret Agents 


CP Sirol Tak 


Defeat Falbe hisi 


Didak WAHT ina 


(i) 
Mo regular intenta yel. Crente iha "imt one. 


inhects: ane mappings between a users queries and acte fulfilled Ey 
your aitwae. Head rone hene 


Before you start. check out Erebul't Agents. a colection of agents 
developed by the Dialogfhow Tear. 


Figure 3-40. Creating a new intent. We would be creating a new 
intent for the chatbot. 
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You then add training parameters or examples, as shown in Figure 3-41. 


— | zzz | 








Figure 3-41. Adding parameters 


You've created a simple flow for the bot. Now you will work on creating 
new entities for the it. 


Creating a New Entity 


In this section, you will work on constructing the bot while creating new 
entities. Click the Entities option and then click Create Entity, as Shown 
in Figure 3-42. 


* Ci |ü imun | np ensures cum cog c9 n2 age LAE d on ape ic p bl 2E T1 laici 


bd Dialogflow ey Entities 


FEH 


he entités wi. cosala Ce el eee. 





Fulfilir et 


Figure 3-42. Selecting the Entities option 
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This creates a field for you with the required details. For pizzas, the 
entity will be Topping, as shown in Figure 3-43. 


€ Co |i Secure https! oregon, oom/an dient agent /Eckabl sg -Ef85 4 be bibis Deis FS blaine 


@ Dialogfiow Topping 
Pizzalbet - 5 


"a Dees s opem D Ei Abos Bred r 


(i) esate moma by pres nini e entes, tab or ; bey 





> Doce 


Figure 3-43. Declare an entity called Topping 


You will add four toppings for this example: 
e Onions 
e Mushroom 
e Peperoni 


e Pineapple 


Now save the Topping parameters.. The bot UI will then look like 
Figure 3-44. 
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= S| sense | ninejenmota dalegfiewenem/aci-cban M (ager edel P585 IUE E Lo BE Eg ETT eE 
ys Dialogtlow Topping 
Maai EJ oeresrongmim [ ] A n at 
Yars 
[-] mente + T 
xs "Lr Nu 
CP Training hl "parcis mages 
Lj) mweganens 
[i| Anatytica inni i Add a rem 


5 Fuime 


[2] Pnbuh ge 


| Saal Tx 


* Docs 


Figure 3-44. The Topping options 


Deploying the Bot 


You have already imported the Small Talk agent. Now you'll import a 


new agent. Let's name the agent Questionbot. The more agents we add it 


becomes easier for the conversational flow. You create a Questionbot and 


now you will try to use prebuilt agents in it, as shown in Figure 3-45. 


c c tecure httpz//consols.düslogiow zom/api-cient/!/agent/S40f20cz-e/52-4«20-bo48-44c5 79d dBeGl/intents 
yd Dialogflow CI Intents 
© + 


c] Defaut Fallhack n^e^t 





& Deisi Welcome intent 


ch Emms 


T Trairáryg Pt 
A^. 
(JJ Integrabons 


5 Publier 


je Preguill Agents 


G Small Tak 


^ Docs 


^ Forum 


Figure 3-45. Adding prebuilt agents 
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your software. Read more here. 


Before you start, check out Prebuilt Agents, a collection of agents 
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You will have to select all the intents available so the bot flow will be 
perfect; see Figure 3-46. 
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Figure 3-46. The Small Talk agent 


Then you need to copy the intents by clicking to put a check mark on 
the copy-related entities and naming the destination agent (in this case, it 
is Questionbot). Next, click Start, as shown in Figure 3-47. 
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Copy intents 


You are about to copy 20 intents into another agent. Please select the destination agent 
Destination agent 


Questionbot [en] 


Copy related entities 


[] Overwrite entities 


[] Overwrite intents 


CANCEL 





Figure 3-47. Copying related entities 


If you now go to the Questionbot, you will see the intents and all 
of the content in the bot. Try are you a bot as a parameter, as shown in 
Figure 3-48. 
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Try it now U 
@; See how it works in Google Assistant. CZ 


Agent Domains 


USER SAYS COPY CURL 
are you a bot 


m 


U) 


ks DEFAULT RESPONSE ~ PLAY 
That's me. | chat, therefore | am. 


INTENT 
smalitalk agent.chatbot 


ACTION 


smalitalk agent.chatbot 


SHOW JSON 


Figure 3-48. You ask a question, and the bot answers 
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Integration with Web Instance 


In this section, you will work toward getting the integration for the Web. We 


will now try to integrate the app to certain platform let's try in Web Demo. 


Lu | @ secum | ntipz//rpraa.ciacogrticur com) 22 denim acer; Ecc af] te) bot TEJE: 
sd Dialogflow C3 Integrations 
Duestionbot - d 
: (Q) (Go) (L3) 


Google Assistant 


Buld Actions for the Boogie Assistant to respi users rough Google Home, And-ned 


phones and mers Seres 


x 


Viber 


(«A A 





Figure 3-49. Selecting the Web Demo integration option. We are 
integrating the bot to enable the web version for conversation. 
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Toggle the slider to right to test the link, as shown in Figure 3-50. 





st the agent on its own page. Share the link to the page or embed the ` widget ir 





https-//bot.dialogflow.com/840f30cc-ef82-4a20-bc48-44c579dd8e6f 


®© Seems that your agent info is not filled yet. Set icon and description for better end-user experience Tt 


Add this agent to your website by copying the code below: 


<iframe 

widths" 358^ 

height="439" 

srce="https://console.dialogflow.com/api-client/demo/embedded/846T30cc -ef92-4e20-bc48-44c579ddse6 
"> 
</iframe> 


CLOSE 


Figure 3-50. Testing the link 
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Integrate the web link for the bot by using an iframe in an HTML page 
so the bot works accordingly, shown in Figure 3-51. 


@ Spe |htipz//bubdulogikem. com EIC! 3Ucc-of92 5e 20- Tei 


Dialogflow APIA DOCS 





Questionbot 








Figure 3-51. Integrating the web link for the bot 


Conclusion 


In this chapter, you worked on two bot frameworks and learned how they 
work. You created a complete deployable bot by using Dialogflow and saw 
its result. This chapter provided simple examples and integrations as well 
as use cases for bots. 
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IBM Watson Chatbots 


Watson is a computer system specifically built for Q-and-A types of 
capabilities. Its core implementations use natural language processing, 
information retrieval, knowledge representation, automated reasoning, 
and machine-learning technologies in the field of open domain question 
answering. It is used for quick AI-based solutions. 

In this chapter, you will learn how to implement IBM’s bot service, 
known as Watson, for your use (see Figure 4-1). In order to access Watson, 
you will create an account for the IBM Cloud (formerly known as Bluemix). 
Then you will use the Watson Assistant (formerly known as Conversational 
Services) to create two chatbots: a FAQ bot and a coffee bot. 


Dogs your 
| buSiness think? 


Nodes Te Dover: of Aland fire data AEE nys ol doing 
Hr UTs put erri fo week 





Figure 4-1. The IBM web page for Watson 
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Implementing Watson 


In this section, you'll learn how to access Watson and you'll get to know 
its various services. You access Watson via the IBM Cloud web site, so 
you will first set up an account through the IBM Cloud for the Watson 


service. We will setup the new account. 


IBM Cloud 


Start by accessing the IBM Cloud by opening a web browser to https: // 
www. ibm.com/cloud-computing/in-en/.Figure 4-2 shows the IBM Cloud 


web site. 


Built for all your applications 
AI ready 
Secure to the core 


The IBM Cloud is the cloud for smarter business. 


Oi Watch the video (0131) | | > Leam more 





What can you do with IBM i 2 3 
Cloud? E Develop cloed-native applications Create cognitive solutions Fuel innovation with data and analyti 
. Rad y develop and deploy irnovative cloud-rative Create new partnerships between people and computers Engage your organization with data to 
x the chad econcery thet eohance, scale and accelerate human expertise theoug usiness questions, uncover pallens 

[or t cokh 4 
wir 

4 ! 6 

He-imagine transactional applications with thochchain Keep existing sofutions on the private cloud Leverage cloud for development and 


Figure 4-2. IBM Cloud main page 


Log in here by using your IBM ID, as shown in Figure 4-3. 
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Sign in to IBM 


Enter IBMid or email Forgot your IBMid? 


po 


Continue 





New? Create an IBMid. 


Figure 4-3. IBM Cloud login window 


After logging in, you will see the web page shown in Figure 4-4. 





Dashboard 
PCD COC Deea DAO CC CLOVO tCUO c9» EPACE veocarice 
AR Amaro ~ e Organiraciorm = 





Fast-track your app derolopmort 


Wam to go Som protocype to production with the cick of a button? Hit the ground saning with one of our IEM Cloud starter kits. You can aiso a o 
Check OR Cur go vin turori s That provide real- oni? coud eclus on examples. 


XT 
oO ful! with Watuce ia Create erteprive-tevet wet appa ¥ Leum to buld, dep», ard scale 


tor ER - Lto Served r Sertori ta Servces av Senses - Lee Sovico - DON 
Accelerate your AL Oeeiogenrent to buld smarter sehn ons Deve op and Copley Closd-Natwe appt ene mines Ute 189 Cloed ro imo emet common patients Dated on best 
practices and oven technologies 








Figure 4-4. The IBM Cloud main console window 
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On this page, click the Create Resource button at the top right, and 


shown in Figure 4-5, to create a resource and add new services. 


Create resource 





Figure 4-5. Creating a new resource. When we create resource 
we then will be able to create conversational bot 


Watson Assistant Service 


In this section, you will see how to set up the Watson Assistant service. 

When we create the resource there are lot of options available. You will 
have to add the Watson Assistant service in it. A lot of services are available 
for Watson, as you can see in Figure 4-6. 





Inirassroctire (7) Waren 
E s Enid episc Ligel amar fal p denaro, L7 kis ed ee Fiona departed 
Maas ^ F NOU ALAHA Dai y nir aw] pum Dico Mri hj ln Li E] 
eart; Lid a ra expense cheers 6a gm lara nm m Lr Bais s rada rh ard nt am. mpra e ard varuralls whe an 
faker Agr wa amanr. 
Tua Lo = Lo Cm 
Pistfenn i AT) 
Rca beige 20 adio = loge Tier aac Matiria 
hal ot FET Fg ht IRR mal DFR LEN Mey RMR and Lt osi E e apte m ww ad: Tk EG FR 
we M Miet ru pt pM eus Pee qe der 
won a ~ e = c 
alec Lenia Pedros ng Do Pursecadry bag aesti Text 
nal«tm > manip ore ome Uh Tes ute aab te 1o: da aan "rz: k 
vog shinies inlet miursu duaniacustaland mt coal ek itin = 
oo = = D 
tangent Tari ic Soh Thoma Ana aye 2 Paia Fasegréteon 
a 
m ij askew ag bo. fuer Bound pas gore sa uc sem vni a ivy [us | CT Fer 
aee ad us ILLI HANEL CORO BEDA. RA DINH I 
m e w = T e 
aluum skrta 
Riad Ap ard mbi | p= [LJ 
Gryka cake mu EH de 
qe c 


Figure 4-6. Various Watson services available 
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For this example, you will choose the Watson Assistant, shown in Figure 4-7. 


Watson 


Build cognitive apps that help enhance, scale, and accelerate human expert 


— . Watson Assistant (formerly Conversation) 


— Add a natural language interface to your application to 
automate interactions with your end users 


Figure 4-7. Choosing the Watson Assistant service 


Next, click the Create button at the bottom right to create the service 
plan for Watson Assistant this shows the different plans for the watson 
assistant service and how much you get with free tier, as shown in Figure 4-8. 





peed aes Mare oue rece eed eee ee ri Heard aiia ol com dl 
mers tee Heer icr ee aes ud Heni, bay ear Sere 
ceri anar uns Dar riang sharri pater rs at neri ani reeled rod ada 





Apes aHa ETETEN RETR Drum 
tia IDE Ced miles T Com Cohen 


Figure 4-8. The Watson Assistant service plan 


The setup is easy. We need to click on create and the setup process will 
move towards completion. After setup is complete, click the Launch tool 
for the service to start. 
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Creating a FAQ Bot 


In this section, you will use the Watson Assistant to create a chatbot that 
uses FAQ for answering. Clicking the Launch tool in the preceding step has 
opened the IBM Watson Assistant screen, shown in Figure 4-9. Click the 
Create a Workspace button at the bottom of the screen to get started. 


A O 
Introducing 
IBM Watson Assistant 
Watson Caowersation © rehing to simgity how yos Duiid and scale virtual aspstants. See what's new 2 


Three easy steps 
Foon these mts 12 eor a wrtvel essistan 


Create intents and entities Build your dialog Test your dialog 
Determine whet you er$22l asistar: mil urderstard dy gecod ng Utilize the intents and entities you cecated, plus contest fon the Try out the wirteel assistant a the tocil to see how £ recognizes the 
treineg cxarmoles sc Watson can baarn. application, vo your vir*ual assistant responds aopropr etoly, incanta anc ontit es and how 4 responds Srethard 


wa more E2 Learn more 2 team more L3 





Figure 4-9. Getting started with the IBM Watson Assistant 


Now you will create the workspace. Click the Workspaces tab and then 
click the Create button in the Create a New Workspace section, as shown in 
Figure 4-10. 


106 


CHAPTER 4 


€ G d Secure | him wa pon sasiri atn g bluemic net eu- 25/7 23d EDS p1 45 ade sat De | dco S aS ei paces 
IBH Watson Assistant 


Hime Workspaces 





Workspaces 





Car Dashboard - Sample 


i Creale a new wo x5 [cE 

| Witt pee enable you t rraintain raparabe iribenbs, uie ; 
' wxxmples, endities, and dialogs for each use ca i 
: application. 






i - é 
|o Firan itin o5 aarahi nora 





ale 
Ed Ed 


Try out the latest features 


A rera viay to Geld vrtael aids tants d eommq. De one of the fra! to Seat Sine the rele aopidach ir 


Leam More 


Figure 4-10. Creating the workspace 


Request Beta 


IBM WATSON CHATBOTS 


qm 


On the next screen, give the workspace name; in this example, type in 


FAQBot and then type in a description, as shown in Figure 4-11. Then click 


the Create button. 
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Create a workspace 


Workspaces enable you to maintain separate intents, user examples, entities, and dialogs for each use or application. 


^ arme 


FAQBot 
Descrip 


This is an FAQ Bot 


Language 


English (U.S.) — 





Figure 4-11. Naming the workspace 


Creating Intent for the Bot 


The next step is to create intents for the bot according to your needs. We need 
to click on add intent. At this point, the Watson console looks like Figure 4-12. 


[BM Watson Assistant 
Kforkapnaces i FAO ! Bud 


Intents Entities Disca Content Catalag 





o` 


No intents yet. 


Án mteri is the goal or purpose of thee ueris input, Adding examples 
ta intentis helps your virtual assistant understand different waya bn 
which people would say them 


Brower available intends to get started wang the Content Catalog 


Browse conbent catalog 





Import intents 


Figure 4-12. Creating a new intent 
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Our FAQBot will be based on IBM Business process on Cloud. Name 


the first intent Capabilities, as shown in Figure 4-13. 


€ 


Intent name 


#Capabilities 


Description 





Mo examples yet. 


Train your virtual assistant with this intent by adding unique examples of what your users would say. 





Figure 4-13. We now add the name of the intent as Capabilities in 
the intent name option. Naming the intent. 


Next, you need to add a description of the intent, as shown in Figure 4-14. 


g #Capabilities 


Intent name 
# Capabilities 
Description 


Capabilities for FAQ Bot 


Add user examples 


Does IBM Business Frocess Manager on Cloud have the same capabilities as the on-premises version] 





No examples yet. 


Train your virtual assistant with this intent by adding unique examples of what your users would say. 


Figure 4-14. Adding a description for the intent 
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Then add examples to the Capabilities intent, as shown in Figure 4-15. 


= O | og Secure | https ‘On ait mg.bluamaicnat/eu-qb/ 7 23d95b2-bé45-ddeg-aaD-O-4e 163 co Saar paced Tod ati - ect A 35 D-bbas-Fadz20 7 bee bank bens 
= € | #Capabilities 


Intent name 


&Capabilities 


Deraiption 
Capabilities for FAQ Bos 


Add wter doce maples 


[] Veer examples (2) a 
[] on premises 


[] Does IBM Business Process Manager on Cloud have the same capabilities as the on-premises version 


Figure 4-15. Adding user examples for the Capabilities intent 


Now you'll create a second intent. Name this intent Migration, as 


shown in Figure 4-16. 


— Q | & Secure | htton/wation-adisista*t ng bluemicnot cu 
#Migration 


Irtent name 
4Mi AI ation 


Description 





Figure 4-16. Creating a new intent named Migration 
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Create a third intent and name it User, as shown in Figure 4-17. 


Ls Cc @ Secure hittps f watson-assistant.ng bluemixnet/eu-gb/723d86b1-b245-4des-aaib-24 
e #User 


Tabent name 


"User 


Deseripbion 


Acid user examples 


| 


[ ] User examples (3) Y 
[] PBDodevelopers count as users 
[] Ool need user license for multipla users 


[] ‘What is a user 


Figure 4-17. Creating a third intent named User 


Now create a fourth intent named SSO, which stands for single 


sign-on, as shown in Figure 4-18. 


€ (C? | & Secure | hupia- aititak Mbh rit/eu-5b/7234 36 b3- 245-4 dee: ifo Ee dod Sas wort paces Soca. ec24- 49 50-biba3-Fad JOTEGI862 ^u Id intent 
= € | #550 
Intent rame 
#550 
Description 
Ahil disait igihe 


L] User examples (1) F 


E Is single szgn-on sugported 





Figure 4-18. Creating the SSO intent 
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Now you have all the intents listed, as shown in Figure 4-19. 





Intorit (4) ¥ Dencigtion 


aCapabilibes Capa&iliigs for FAQ Bot 





Figure 4-19. All intents listed 


The Dialog Flow for the App 


In this section, you will create the dialogs for the FAQBot. Click the Dialog 
tab and then click the Create button, as shown in Figure 4-20. 


Ko dialog yet 


A dialag uses inter, entit»es, and context from your application to define à response to each user's impul: Creating a dialog 
dafnas how your virtual acsisiang will respond to what your users are caring. 





Figure 4-20. The dialog creation space. Here we will be creating the 
dialog flow for the bot created we need click on create. 
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On the next screen, click Welcome so that we can start the 


conversation with a greeting over here, as shown in Figure 4-21. 





IBM Watson Assistant 


Workspaces / FAQBot / Build 


Intents Entities Dialog ^ Content Catalog 


C) FAQBot 


Welcome 

welcome ü 
o 
o 

Re p 1 ont tr n 

Anything else 

anything _else o 
o 
o 

1 Response /O Context set / Does not return 





Figure 4-21. The dialog workflow 


Making Sense of the Flow 


Now that you've created various dialogs with creation of dialogs we 
are linking the flow of the bot to work efficiently, you're ready to create 
interactions in this section by linking up the entire flow. You'll start by 
adding an intention for what you want to do. 


XXXXXXXXXXXXXXX, as shown in Figure 4-22. 
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Figure 4-22. Creating a new node we want to touch on every 
information to be touched upon and also the flow to be perfect. 


Next, add other intentions for the Migration intent, as shown in 
Figure 4-23. 


L Assistant 


Telset 





Figure 4-23. Adding a new node for the Migration intent 


Add an intention for the User intent, as shown in Figure 4-24. 
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_ a Cr» 
em a x 
Cz) FAL 
i 
4 
Figure 4-24, Adding new intent User 
Now add a single sign-on, as shown in Figure 4-25. 
o 
«=D 





Figure 4-25. Adding nodes for SSO 


Trying the Bot 


In this last section for our first bot, you will see how to interact with the bot. 
Click the Try It button at the top right to access a Try It Out link, shown in 
Figure 4-26. Let’s try out the bot now. 
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Last modified 43 minutes ago DV, 





try It out Clear Manage Context @ X 
| ME - 


as 
~~? 





| I didn't understand. You can try rephrasing. 
how do I login 


| Irretevant wA | 


| Can you reword your statement? I'm not 
understanding. 


what are the capabilities 





| A user is anyone with access to the IBM Business 
Process Manager on Cloud service—concurrent or 
authorized users. This includes authors or designers, 
testers, administrators and end users. Users in your 
account are tracked on the Admin tab of the portal. 


on premises 


?#Capabilities 


| Yes. IBM® Business Process Manager on Cloud has the 


full capabilities of IBM Business Process Manager on 
premises that are compatible with: IBM Business 
Process Manager Express, IBM Business Process 
Manager Standard and IBM Business Process Manager 
Advanced. The process assets are portable. 


Figure 4-26. Trying the bot. Here we are just testing the bot how it 
works and the flow logic is perfect or not. 
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In the following section, you will create another bot. This one will help 


the user order coffee. 


Creating a Coffee Bot 


In this section, you will create a CoffeeBot with Watson Assistant. This bot 
will help the user order a cup of coffee. First you will create a workspace; 
then you will create new intents and add entities. Next, you will add 


dialogs. Finally, you'll create a nested structure for the intents. 


Creating a Workspace 


To get started, you will create a new workspace. The workspace is created 
from watson assistant window and for the new bot creation this step is 


taken, as shown in Figure 4-27. 


Create a new workspace 


Workspaces enable you to maintain separate intents, 
user examples, entities, and dialogs for each use or 
application. 


; ege " ^f oL ve bte ane Sree = 
You are using 1 of available workspaces in this instance. 
kangi 


Create (+) 





Figure 4-27. Creating a new workspace for the coffee bot 
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On the screen that opens, name the chatbot CoffeeBot, as shown in 
Figure 4-28. Then click the Create button. 


Create a workspace 


Workspaces enable you to maintam separate intents, user examples, entities, and dialogs for each use or application, 


CoffeeBot| 


English (U.5.) Wr 





Figure 4-28. Naming the workspace 


Working with Intents 


In this section, you will start creating intents for the usage of our bot. Click 
the Intents tab and then click the Add Intent button, as shown in Figure 4-29. 
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Workspaces / ColfeaBat / Build 


Intents Erilities alog Conan: Catalog 





o 


No intents yet. 


dun eben zs Whe goal ce purpose of the uea s mpl. Adding examples 
Ja mienis helps voor virtu] arasan understand diferent ways in 
which people would say Them. 


Browse available intents 1o get slanted umng the Content Catalog 


eam — 


Browse content earaleg 





Import sntents 


Figure 4-29. Creating the intent for the CoffeeBot 


Let's start by creating an intent named Greetings, as shown in Figure 4-30. 


< 


Intent name 


#Greetings 


Description 





No examples yet. 


Train your virtual assistant with this intent by adding unique examples of what your users would say. 





Figure 4-30. Naming the intent Greetings 
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There are different ways that the bot can greet a user. You'll use this 
screen to choose from the options, as shown in Figure 4-31. 


c Q | @ Secure | https; /watson-assistant.ng.bluemrcnet/eu-qb/ /23d56b3-b245-Adee-aafb-S4e1fdcb55aS/workspaces/e9501126-: 


= «€  #Greetings 


Intent name 


#Greetings 


Description 


Add user examples 





User examples (4) ¥ 


a L 


Hello 


Hi 


a E] 


Howdy 


Yo 


LJ 





Figure 4-31. Adding user examples 
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Next, you'll add an intent named BuyCoffee, as shown in Figure 4-32. 


c 


Intent name 


#BuyCoffee| 


Description 





No examples yet. 


Train your virtual assistant with this intent by adding unique examples of what your users would say. 





Figure 4-32. Creating a new intent named BuyCoffee 


Add some examples for it, as shown in Figure 4-33. 
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«€  #BuyCoffee 


Intent name 


sBuyCoffee 


Description 


Add user examples 





User examples (5) ¥ 
Can you sell me a Coffee 


Get me a Coffee 


I would like to buy a coffee 


E 
[] 
K 
[] Ineeda Coffee 
O 
O 


Order a Coffee 





Figure 4-33. Adding user examples 


Create another intent and name it Suggestion, as shown in Figure 4-34. 


© 


Intent name 


au Tour -pee 
#oudgestion 
SB 


Description 





No examples yet. 


Train your virtual assistant with this intent by adding unique examples of what your users would say. 


Figure 4-34. Creating a new intent named Suggestion 
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Add some examples to this new intent, as shown in Figure 4-35. 


-— «€ | #Suggestion 


Intent name 


# Suggestion 


Description 


Add user examples 


User examples (7) ¥ 

Can you suggest me 
Help me pick one please 
Suggestions please 
What are my options 
What can i order here 


What do you sell 


CS LI HLE O ELS LI BLS L 


What options do i have 





Figure 4-35. Adding user examples for Suggestion 
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Next, add another intent named Yes, as shown in Figure 4-36. As you 
did previously for the other intents, add user examples. 


€ #Yes 


Intent name 


£Yes 


Description 


Add user examples 


E 


User examples (4) ¥ 
For Sure 

I want it 

I want to order 


| Ofcourse 


Figure 4-36. Adding user examples for the Yes intent 
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ThankYou will be the next intent, as shown in Figure 4-37. Name this 
intent and add examples. 


<- #ThankYou 


Intent name 


£ThankYou 


Description 


Add user examples 


Add example 


[ |] Userexamples (4) v 

[] Itissososweet of you 
[] Thanks 

[] Thanksalot 

[] Thanksaton 


Figure 4-37. ThankYou intent and user examples 
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The next intent will be Cancel, as shown in Figure 4-38. Follow the 


same process to name it and add examples. 


€ s Cancel 


Intent name 


Cancel 


Description 


Add user examples 


| 


User examples (5) ¥ 

Can I request you to Cancel the order 
Can I revert my order 

Cancel it 

Cancel the order 


Please cancel the order 


LIN Lj BLIM CJ LIH L 


Figure 4-38. Adding the Cancel intent 


Working with Entities 


In this section, you will working with entities to get the bot more 
structured. Click the Entities tab and then My Entities to access the screen 
shown in Figure 4-39. Click the Add Entity button. 
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Figure 4-39. Adding entities 
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e 


No entities yet. 


An entity i$ a portion of the user's input that you can use to provide a 
different response to a particular intent. Adding values and synonyms 
to entities helps your virtual assistant learn and understand 


important details that your users mention. 


On the screen that opens, name the entity by typing CoffeeSize, as 
shown in Figure 4-40. Then click the Create Entity button. 


One venu ve nane] yoa entity, begin by adding values, synoria, acd palleira ro entities bo help your sirtual assistant earn and understand impartant details thal your wies meritis, 


Figure 4-40. Naming the entity CoffeSize 


On the next screen, choose values for CoffeeSize, as shown in Figure 4-41. 
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€ @CoffeeSize 


Entity name 
@Coffeesize 


Value name Synonyma 
| Synonyms V, o 


[]  Entityvalues(3) v Type 
Large Synonyms Big 
C] Medium Synonyms Regular, Not too big 
LI small Synonyms Low Price, Cheap, Cheapest, Smallest, Tiny 


Figure 4-41. Adding values for the CoffeeSize entity 


Now add an entity named here we select the different sizes that are 


available for CoffeeOptions, as shown in Figure 4-42. 


€  @CoffeeOptions 


Entity name 
@CotieeOptions 


Value name Synonyms 

| Synonyms wr o 

[ |  Entityvalues (4) v Type 

[] Black Synonyms standard black, roasted black, dark black 
L] Cappucino Synonyms capuchino, cappuchino, capucino 

[] mocha Synonyms mocha, cafe moccha, mace, cale mocha 
[] Vanilla Latte Synonyms Latte, Vanilla, Vanilla Latte 


Figure 4-42. Adding synonyms for CoffeeOptions 
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Working with Dialogs 


In this section, you will work with dialogs that will create a flow for 
seamless interactions between the bot and the user. 

From the XXXX screen, do XXXXX to add a new dialog, as shown in 
Figure 4-43. 


[BM Watson Assistant 


No dialog yet 


A dialog uses Intents, entizies, and contest from your application to define a responsa to each user's input. Creating a dialog. 
defines [ow your virtual asta will respond Tà wal your ube are Hiig, 





Figure 4-43. Adding a new dialog 


After creating the dialog, the workspace looks like Figure 4-44. 
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IBM Watson Assistant 


Workspaces / CoffeeBot / Build 


Intents Entities Dialog Content Catalog 


Add node Add tolder 


C2 CoffeeBot 





Welcome 


welcome 

1 Response / 0 Context set / Does not return 
Anything else 

anything eise 


1 Response / 0 Context set / Does not return 


Figure 4-44. Adding the dialog flow for the bot 


You will have to add additional dialogs for the bot so that you can bring 
the things together. In this place itself we add different logic so that the bot 
works properly You've already created intents as well as entities for ordering 
coffee, so now you can use them to create the workflow. 

Let's first add a node where we are requesting for buying a coffee, as 


shown in Figure 4-45. 
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Workspaces / CoffeeBot / Build 


Intents Entities Dialog Content Catalog 


Add node Add child node Add folder 


E CoffeeBot 








Welcome 


welcome 


[ 


1 Response / 0 Context set / Does not return 


#BuyCoffee 


1 Response / 0 Context set / Does not return 





Anything else 


l anything else 


1 Response | O Context set / Does not return 


Figure 4-45. Adding a new node for BuyCoffee 


131 


CHAPTER 4 IBM WATSON CHATBOTS 


The content and response for the bot is shown in Figure 4-46. 


Name this node... @ Customize Y 
If bot recognizes: 
#BuyCoffee @ 
Then respond with: o 
o 
1. I will do that for you!!Thanks a ton. o 


[Add a variation to this response 


And finally 


Wait for user input wy 


Figure 4-46. Adding a response for BuyCoffee 


Next, add a new Suggestion node for the CoffeeBot, as shown 
in Figure 4-47. In this node, you will create child nodes to indicate 


preferences for different coffee types. 


132 


CHAPTER 4 IBM WATSON CHATBOTS 





i |. Which nye o! Colles weld you kke 





Figure 4-A7. Adding a new Suggestion node 


Nested Intents 


This section covers how to use nested intents so that you can match up the 
flow that is how the bot will work accordingly as we have meant it to be for 
the bot. 

To the right of each node name, you can see three vertical dots, 
as shown in Figure 4-48. These dots are used to create a nested child 
workflow. XXXXXXXXXXX 
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#Suggestion 
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1 Response / 0 Context set / Does not reti 
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Add folder 


Move 


(1 


Duplicate 
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Delete 


Figure 4-48. Adding a new child node 


You can now see the child node you've created for the coffee options, 
as shown in Figure 4-49. 
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Figure 4-49. Adding nested intent 


, as shown in Figure 4-50. 
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#Suggestion 
1 Response / 0 Context set / Does not return 
| @CoffeeOptions 
1 Response / 0 Context set / Return allowed 


@CoffeeSize:small 


eo 
o 
o 

1 Response / 0 Context set 

@CofteeSize:Medium 
o 
o 
e 


1 Response / 0 Context set 


@CoffeeSize:Large 


1 Response | 0 Context set 





Figure 4-50. Nested intent conveys what we are doing for purchasing 
or ordering coffee with all the options for small, medium, and large 


Now the next node will be for canceling the order. XXXXXXXXXXX, as 
shown in Figure 4-51. 
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Figure 4-51. Canceling the status of the order is done here through 
the conversation with the dialogs order 
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You will have options for Yes and No, so further nesting the process is 


required. When you add up all the nodes, you get the categorized structure 


shown in Figure 4-52! 


Workspaces / CoffeeBot / Build 


Intents Entities Dialog Content Catalog 


Add node 
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welcome 


1 Response / 0 Context set / Does not return 
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#Cancel 


1 Response / 0 Context set / Jump to 


#ThankYou 


1 Response / 0 Context set / Does not return 


Add child node Add folder 
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Figure 4-52. 
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anything_else 


1 Response / 0 Context set / Does not return 


ooo 


The complete workflow for the CoffeeBot 
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Conclusion 


In this chapter, you learned how to get started with the IBM Cloud; note 
that IBM offers a free one-month trial of this service. 

This chapter also introduced IBM Watson. You learned how to create 
two chatbots with Watson Assistant. 

In the last chapter, your journey to learn about chatbots will continue. 


You will create TensorFlow chatbots and learn about their uses. 
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Chatbot with 
TensorFlow 


In this chapter, you will create chatbots by using TensorFlow. You'll start by 
learning some TensorFlow basics. 

You'll work on open source models. Then you'll then move on to 
different approaches for creating the chatbots. You'll set up a TensorFlow 
GPU with access to NVDIA CUDA. You'll closely examine CUDA and then 


create the chatbots. 


TensorFlow Basics 


TensorFlow is a data science framework primarily meant for dataflow-based 
work. It uses Tensors and their approach to nodes in an effective way so that 
we can easily implement it in machine learning as well as deep learning, a 
Tensor is a generalized matrix that might be 1d, 2d or of higher order. 

This section presents the basics of Tensors and of setting up the proper 
working environment. Later in this chapter, you will construct a neural 
network from scratch in TensorFlow and then use the TensorBoard feature 


to see how a TensorFlow graph works. 
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Setting Up the Working Environment 


This section provides an overview of the way the Anaconda distribution for 
Python is set up with the GPU version. 

You will work on activating the Anaconda environment and start your 
TensorFlow basics from there. 

You'll use an Anaconda distribution for Python and then install 
TensorFlow with it. You'll be working with the GPU version. First you 


activate the Anaconda environment, as shown in Figure 5-1. 


ME inaconda Prompt 


(C:\Program Files\Anaconda3} C:XUsersiabhissactivate tensorflow-gpu 


(tensorflou-gpu) C:\Users\abhis>,, 





Figure 5-1. Activating the TensorFlow environment 


You'll use Intel-optimized Python for writing the code in Python. The 


mode is shown in Figure 5-2. 


EB Anaconda Prompt | python 
(C:\Program Files\Anaconda3) C:\Users\abhis>activate tensorflow-gpu 


(tensorflow-gpu) C:\Users\abhis>python 
Python 3.5.2 |Intel Corporation| (default, Feb 5S 2017, 02:57:01) [MSC v.1900 64 bit (AMD64)] on win32 


Type "help", "copyright", "credits" or "license" for more information. 
Intel(R) Distribution for Python is brought to you by Intel Corporation. 
Please check out: https://softwarc.intel.com/en-us/python- distribution 
>>> 





Figure 5-2. Intel-optimized Python 
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Now let's check our version of TensorFlow, as shown in Figure 5-3. 


BE Anaconda Prompt- python = o A 





C:\Program Files\Anaconda3) C:\Wsers\abhissactivate tensorflow-gpu 


tensorflow-gpu) C:\Users\abhis python 
ython 3.5.2 |Intel Corporation| (default, Feb 5 2817, 82:57:81) [MSC v.1988 64 bit (AMDB4)] on wini 
ype "help", "copyright", "credits" or "license" for more information. 


ntel(R) Distribution tor Python is brought to you by Intel Corporation. 
lease check out: https://software.intel.com/en-us/python-distribution 
>> Import tensorflow as tf 

>> print(tf. version ) 

41,8 

>> 


Figure 5-3. Checking the version of TensorFlow 
To check the version, first you import TensorFlow: 


>>> import tensorflow as tf 
>>> print(tf. version ) 
1.1.0 


Let's just break the word tensor it means n-dimensional array. 

You will create the most basic thing in TensorFlow that is constant. 
You will create a variable named hello. The work is shown here and in 
Figure 5-4: 


»»» import tensorflow as tf 

»»» hello - tf.constant("Hello") 

»»» Intel - tf.constant("Intel") 

»»» type(Intel) 

«class 'tensorflow.python.framework.ops.Tensor'» 
»»» print(Intel) 

Tensor("Const 1:0", shape=(), dtype=string) 


»»» with tf.Session() as sess: 

-— result-sess.run(hello-«Intel) 
Now we print the result. 

»»» print(result) 

b'Hello Intel ' 

>>> 
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Figure 5-4. Working with TensorFlow 
Now let's add two numbers in TensorFlow. First, you declare two 
variables: 


»»» a -tf.constant(50) 
»»» b -tf.constant(70) 


You check the type of one of the variables: 


»»» type(a) 
«class 'tensorflow.python.framework.ops.Tensor'» 


Here, you can see that the object is of type Tensor. 
To add two variables, you have to create a session: 


»»» with tf.Session() as sess: 
result = sess.run(a+b) 


To see the result, just type result: 


>>> result 
120 
>>> 
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Creating a Neural Network 


In this section, you will create a neural network that performs a simple linear 
fit to some 2D data. You will work with TensorFlow to create a graph. You'll 
initiate the session, feed the data into TensorFlow, and get the output. 

Figure 5-5 shows the flow of work in TensorFlow. 


Figure 5-5. Flow of TensorFlow 
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Figure 5-6 shows the structure of the neural network that you'll create. 





Figure 5-6. Constructing a neural network 


You use the following linear equation to implement the neural network: 
WX -bz-2Z 


You will add in a cost function to train the network to optimize the 
parameters. 


First, import NumPy and TensorFlow: 


(C:\Program Files\Anaconda3) C:\Users\abhis>activate 
tensorflow-gpu 

(tensorflow-gpu) C:\Users\abhis>python 

Python 3.5.2 |Intel Corporation| (default, Feb 5 2017, 
02:57:01) [MSC v.1900 64 bit (AMD64)] on win32 

Type "help", "copyright", "credits" or "license" for more 
information. 

Intel(R) Distribution for Python is brought to you by Intel 
Corporation. 

Please check out: https://software.intel.com/en-us/python- 
distribution 

»»» import numpy as np 

»»» import tensorflow as tf 

>>> 
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You need to set random seed values for our process: 


»»» np.random.seed(101) 
>>> tf.set random seed(101) 


Add some random data: 
Using rand a =np.random.uniform(0,100(5,5)) 


You add random data points going from 0 to 100 and then ask 
operations logic to be in the shape of (5,5). You do the same for b: 


>>> rand a =np.random.uniform(0, 100, (5,5)) 
>>> rand a 
array([[ 51.63986277,  57.06675869, | 2.84742265, 17.15216562, 
68.52769817], 
[ 83.38968626, 30.69662197, 89.36130797, 72.15438618, 
18.99389542 |, 
[ 55.42275911, 35.2131954 , 18.18924027, 78.56017619, 
96.54832224], 
[ 23.23536618,  8.35614337, 60.35484223, 72.89927573, 
27 .62388285 |, 
[ 68.53063288, 51.78674742,  4.84845374, 13.78692376, 
18.69674261]]) 
»»» rand b 
array([[ 99.43179012], 
[ 52.06653967], 
[ 57.87895355], 
[ 73.48190583], 
[ 54.19617722]]) 
Create placeholders for these uniform objects: 


>>> a 
>>> b 


tf.placeholder(tf.float32) 
tf.placeholder(tf.float32) 
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You use TensorFlow because it understands normal Python operations: 


>>> add op = a + b 
>>> mul op = a * b 


Now you'll create sessions that use graphs to feed dictionaries to get 
results. First declare the session and then get the results of the add operation. 
Pass in the operation and the feed dictionary. For the placeholder objects, 
you need to feed data; you will do that by using the feed dictionary. 

Pass data to the keys A and B: 


add result = sess.run(add op, feed dict={a:10,b:20}) 

>>> with tf.Session() as sess: 
add result = sess.run(add op,feed dict={a:10,b:20}) 
print(add result) 


As you have created random result, you will pass it to the feed dictionary: 


»»» with tf.Session() as sess: 
add result - sess.run(add op,feed 
dict-(a:rand a,b:rand bj) 


Print the value of add result: 


»»» print(add result) 

[[ 151.07165527 156.49855042 102.27921295 116.58396149 167.95948792]| 
[ 135.45622253  82.76316071 141.42784119 124.22093201  71.06043243] 
[ 113.30171204  93.09214783  76.06819153 136.43911743 154.42727661]| 
[ 96.7172699 4 81.83804321 133.83674622 146.38117981 101.10578918 | 
[ 122.72680664 105.98292542  59.04463196  607.98310089 72.89292145 || 


Create a matrix for multiplication: 


»»» with tf.Session() as sess: 
mul result = sess.run(mul op,feed dict={a:10,b:20}) 
print(mul result) 

200 
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Use the following random values: 


»»» with tf.Session() as sess: 
mul result - sess.run(mul op, 
feed dict-(a:rand a,b:rand bj) 
»»» print(mul result) 


[[ 5134.64404297 5674.25 283.12432861 1705.47070312 
6813 .83154297 | 
[ 4341.8125 1598.26696777 4652.73388672 3756.8293457 


988.9463501 | 

[ 3207.8112793  2038.10290527 1052.77416992 4546.98046875 
5588.11572266 | 

[ 1707.37902832  614.02526855 4434.98876953 5356.77734375 
2029.85546875 | 

[ 3714.09838867 2806.64379883  262.76763916 747.19854736 
1013.29199219]] 


Create a neural network from result we obtained. Let's add some 
features to the data: 


»»» n features -10 
Declare the number of layers of neurons. In this case, you have three: 
»»» n dense neurons - 3 


Let's create a placeholder for x and add the data type, which is float. 
Then you have to find the shape. First, you consider it None because it 
depends on the batch of data you are feeding to the neural network. 
Columns will be the number of features. 


»»» x - tf.placeholder(tf.float32,(None,n features)) 
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Now you have the other variables. W is the weight variable, and you 
initialize this with some sort of randomness; then you have the shape of it be 
based on the number of features with the number of neurons in the layer: 


>>> W = tf.Variable(tf.random normal([n features,n dense neurons])) 


Declare the bias. 

You declare the variables and can have it as ones or zeros we are using 
the function within TensorFlow. Keep in mind that W will be multiplied by 
X, SO you need to maintain the dimension of column with dimension of 


rows for matrix multiplication: 


»»» b - tf.Variable(tf.ones([n dense neurons]) 


222 
Create an operation and activation function: 
»»» xW - tf.matmul(x,W) 
Create the output z: 
>>> Z = tf.add(xW,b) 
Create the activation function: 
»»» a - tf.sigmoid(z) 
To complete the graph or the flow, run them in a simple session: 


»»» init - tf.global variables initializer() 
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Finally, pass in a feed dictionary to create a session: 


»»» with tf.Session() as sess: 
sess.run(init) 
layer out = sess.run(a,feed dict={x:np.random. 
random([1,n features])]) 

»»» print(layer out) 

[| 0.19592889 0.84230143 0.36188066] | 


You have now created a neural network and printed the final output 
layer. 


Working with the Activation Function 


You will now start working with the activation function and implement it 
in TensorFlow to view any layer you want. You get accordingly the Intel- 
optimized Python mode. You need to enable the environment again, as 
shown in Figure 5-7. 


(C:\Program FilesViAnacondai3) C:\Wsers\abhissactivate tensorflow-pgpu 


(tensorflow-gpu) C:XUsersiabhis»python 
Python 3.5.2 |Intel Corporation| (default, Feb 5 2017, 82:57:81) [MSC v.1900 64 bit (AMD64)] on wi 
Type "help", "copyright", "credits" or "license" for more information. 


Intel(R) Distribution for Python is brought to yo 
Please check out: https://software.intel.com/en-us/py 





Figure 5-7. Enabling the environment again 
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Now you import to get inside TensorFlow: 
»»» import TensorFlow as tf 


Next you implement the layer function. 

For the layer, you should have inputs; this is the information being 
processed from the last layer. Using in size determines the size of the 
input; this also describes the number of hidden neurons for the last layer. 
Using out layer shows the number of neurons for this layer. Then you 
declare the activation function, which is None—that is, you are using a 
linear activation function. 

You have to define weight that is based on input and output size. 

You will have to use random normal to generate the weights. You will 
then pass the input and the output size. Initially, you use randomized 
values because it improves the neural network. 

You declare one-dimensional biases. You will initialize biases as zeros 
and initialize all variables as 0.1. The dimension of it is 1 row and out. size 
the no of columns. Because you want to add the weights to the bias, the 
shape should be the same, so you use out size. 

For the operation or the compute process, you use matrix multiplication: 


def add layer(inputs, in size, out size, 
activation function=None): 
Weights - tf.Variable(tf.random normal([in size, out size])) 
biases = tf.Variable(tf.zeros([1, out size]) + 0.1) 
Wx plus b = tf.matmul(inputs, Weights) + biases 
if activation function is None: 
outputs = Wx plus b 
else: 
outputs = activation function(Wx plus b) 
print (outputs) 
return outputs 
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In the next section, you will review an important feature of TensorFlow 
known as TensorBoard, which is useful for viewing the graph as well as 
debugging. 


TensorBoard 


Let's talk about TensorBoard. TensorBoard is a data visualization tool 
that is packaged within TensorFlow. When you are dealing with creating 
a network in TensorFlow, it's composed of operations and tensors. When 
you feed data into the neural network, the data flows in through tensors 
performing operations, and finally getting an output. 

TensorBoard was created to know the flow of tensors in a model. 
It helps in debugging and optimization. Let's create some graphs and 
then show them in TensorBoard. The basic operations are addition and 
multiplication. 


Figure 5-8 shows how a session works in TensorFlow. 
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HHH 


i—_. O 


Figure 5-8. Creating a session with TensorFlow 


Import TensorFlow as follows: 
Import tensorflow as tf 


We are showcasing an addition operation and showing the result in the 
tensorboard. 
Then declare placeholder variables: 


>< 
II 


tf.placeholder(tf.float32, name="X") 
tf.placeholder(tf.float32, name="Y") 


< 
II 
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Next, you need to declare the operations that you need to perform: 
addition = tf.add(X, Y, name-"addition") 


In the next step, you have to declare session. You want to perform 
operations, and you need to perform the operations inside a session. You 
have to initialize the variables by using init. Then we have to run the sess 
within init: 


sess - tf.Session() 
# tf.initialize all variables() no long valid from 
# 2017-03-02 if using tensorflow >= 0.12 
if int((tf. version ).split('.')[1]) < 12 and int((tf. - 
version ).split('.')[0]) < 1: 
init = tf.initialize all variables() 
else: 
init = tf.global variables initializer() 
sess.run(init) 


When you run the session using a feed dictionary, you initialize the 
values of the variables: 


result - sess.run(addition, feed dict -(X: [5,2,1], Y: [10,6,1]]) 


Finally, using the summary writer, you get the debugging logs for the 
graph: 


if int((tf. version ).split('.')[1]) < 12 and int((tf. - 
version ).split('.')[0]) < 1: # tensorflow version < 0.12 
writer - tf.train.SummaryWriter('logs/nono', sess.graph) 
else: # tensorflow version >= 0.12 
writer - tf.summary.FileWriter("logs/nono", sess.graph) 
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The entire code base in Python looks like this in a single oriented flow: 


import tensorflow as tf 
X = tf.placeholder(tf.float32, name="X") 
Y = tf.placeholder(tf.float32, name="Y") 


addition = tf.add(X, Y, name="addition") 


sess - tf.Session() 
# tf.initialize all variables() no long valid from 
# 2017-03-02 if using tensorflow >= 0.12 
if int((tf. version ).split('.')[1]) < 12 and int((tf. - 
version ).split('.')[0]) < 1: 
init = tf.initialize all variables() 
else: 
init = tf.global variables initializer() 
sess.run(init) 


if int((tf. version ).split('.')[1]) < 12 and int((tf. - 
version ).split('.')[0]) < 1: # tensorflow version < 0.12 
writer - tf.train.SummaryWriter('logs/nono', sess.graph) 
else: # tensorflow version >= 0.12 
writer = tf.summary.FileWriter("logs/nono", sess.graph) 


Let’s now visualize the graph generated. Go to the Anaconda prompt. 
Activate the environment and go to the folder to run the Python file. In 
Figure 5-9, you are enabling the Intel-optimized Python mode again. 


GB Anaconda Prompt - python " g 





Figure 5-9. Enabling Python mode 


154 


CHAPTER 5 CHATBOT WITH TENSORFLOW 


Now you need to run the Python file. Use the following command to 
get the output shown in Figure 5-10: 


(tensorflow-gpu) C:\Users\abhis\Desktop>python abb2.py 


Figure 5-10. Running the code 


Now open TensorBoard: 


(tensorflow-gpu) C:\Users\abhis\Desktop>tensorboard 

- -logdir-logs/nono 

WARNING:tensorflow:Found more than one graph event per run, or 
there was a metagraph containing a graph def, as well as one or 
more graph events. Overwriting the graph with the newest event. 
Starting TensorBoard b'47' at http://0.0.0.0:6006 

(Press CTRL+C to quit) 


Now let’s open the browser for TensorBoard access. 
The following link needs to be opened: 


http://localhost :6006/ 


Figure 5-11 shows the addition operation in TensorBoard. 
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Session 
TURE io 


Upload 
Trace inputs » 
Color (m Suim 


C) Device 
C xa 


C) 
a 


Figure 5-11. TensorBoard output 


For multiplication, the same process is followed and the code base is 
shared here: 


import tensorflow as tf 
X = tf.placeholder(tf.float32, name="X") 
Y = tf.placeholder(tf.float32, name="Y") 


multiplication - tf.multiply(X, Y, name-"multiplication") 


sess - tf.Session() 
# tf.initialize all variables() no long valid from 
# 2017-03-02 if using tensorflow >= 0.12 
if int((tf. version ).split('.')[1]) < 12 and int((tf. - 
version ).split('.')[0]) < 1: 
init = tf.initialize all variables() 
else: 
init = tf.global variables initializer() 
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sess.run(init) 
result = sess.run(multiplication, feed dict -(X: [5,2,1], Y: 
[10,6,1]}) 


if int((tf. version ).split('.')[1]) < 12 and int((tf. - 
version ).split('.')[0]) < 1: # tensorflow version < 0.12 
writer - tf.train.SummaryWriter('logs/no1', sess.graph) 
else: # tensorflow version >= 0.12 
writer = tf.summary.FileWriter("logs/no1", sess.graph) 


Figure 5-12 shows the multiplication graph. 





T ai (1) 


Figure 5-12. Multiplication analysis in TensorBoard 


Let’s work with a more complex tutorial to see how the TensorBoard 
visualization works. You will be using activation function definition shown 
previously. 

Declare placeholders: 


xs = tf.placeholder(tf.float32, [None, 1], name='x input') 
ys = tf.placeholder(tf.float32, [None, 1], name='y input') 


Add a hidden layer with the relu activation function: 


11 = add layer(xs, 1, 10, activation function-tf.nn.relu) 
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Add the output layer: 

prediction = add layer(11, 10, 1, activation function-None) 
Calculate the error: 


with tf.name scope('loss'): 
loss - tf.reduce mean(tf.reduce sum(tf.square(ys - prediction), 
reduction indices-[1])) 


Next you need to train the network. You will be using the gradient 


descent optimizer: 


train step = tf.train.GradientDescentOptimizer(0.1).minimize(loss) 


Versions of TensorFlow 


The current versions of TensorFlow that are available are as follows: 


e rl.8 
e rl.7 
e rl.6 
e rl.5 
e Irl.4 
e rl.3 
e rl.2 
e fri.l 


The various versions of TensorFlow are available at the TensorFlow 
branch, www. tensorflow.org/versions/. 
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Keras Overview 


This section introduces a front-end wrapper to a deep learning framework 


known as Keras. Then we will work along with how we implement Keras 


using a Jupyter Notebook and creating chatbots with it. 


Keras is front-end wrapper that can be used with lots of deep learning 


frameworks at the back end. 


Keras has already been built up neural network function that you can 


use to get the neural networks easily and fast. It maintains the following: 


Modularity 
Minimalism 
Extensibility 


Python nativeness 


As a basic starting point for Keras, you will run a "Hello World" 


example. With respect to machine learning and deep learning, a Hello 


World example is different. 


In this example, you will use the iris dataset. You need to check that 


the following libraries are installed: 


seaborn 
numpy 
sklearn 
keras 


tensorflow 


TensorFlow will be the background for the Keras wrapper. 


You will sync a GitHub project: 


https://github.com/fastforwardlabs/keras-hello-world 
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The important files will be downloaded via a reqirements.txt file. 
Let's open an Anaconda prompt and get inside the Tensorflow-gpu 


environment: 
(C: \Users\abhis\Anaconda3) C:\Users\abhis>activate tensorflow-gpu 


Now you will clone the project files, which will copy the essential files 
into the folder and create a local copy in the machine: 


(tensorflow-gpu) F:\>git clone https://github.com/ 
fastforwardlabs/keras-hello-world.git 
Cloning into 'keras-hello-world'... 
remote: Counting objects: 94, done. 
remote: Total 94 (delta 0), reused 0 (delta 0), pack-reused 94 
Unpacking objects: 100% (94/94), done. 


Now you install the necessary files by using the following code: 
(tensorflow-gpu) F:\keras-hello-world>pip install requirements 


You'll launch the Jupyter Notebook. But first let's import the libraries, 
as shown in Figure 5-13. 


import seaborn as sns 
import numpy as ng 


from sklear^.moódel selection import train test split 
from sklearn.linear_sodel import LogisticRegressionCV 


from keras.models import Sequential 
from keras.layers.core import Dense, Activation 
from keras.utils import np_utils 


users \abhis \.conda \envs \tensorf low-gou\] lb\site-peckaeges \hSpy init py: 36: FutureWarning: Conversion o 
nt of issubdtype froe "float to ‘ap.floating is deprecated. In future, it will be treated as np.floaté4 == np.dtype(float).t 


Figure 5-13. Importing libraries 
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The program starts using TensorFlow back end. 


The iris dataset is indeed useful for machine learning, and you 
load it first: 


iris = sns.load dataset("iris" 
iris.head() 


Figure 5-14 shows how the iris dataset is loaded. 


In [4]: iris = sns.load dataset("iris") 
iris.head() 
Out[4]: 
sepal length sepal_width petal length petal width species 


ü 51 35 14 02 celra 
1 49 30 14 02 seta 
2 aT 32 13 02 setota 
3 46 31 1.5 O2 sea 
4 50 iB 14 02 seima 





Figure 5-14. Using iris dataset 


Now you visualize the dataset: 
sns.pairplot(iris, hue='species'); 


In Figure 5-15, you are plotting the species. 
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In [5]: sns.pairplot(iris, huee'species'); 





& 
sepal length 


3 4 
sepal width 


Figure 5-15. Plotting the species 


Now you split the data into training and testing datasets. 
First pull the raw dataframe: 


X = iris.values[:, :4] 
y = iris.values[:, 4] 


Then split the data: 


train X, test X, train y, test y - train test split(X, y, 
train size-0.5, test size-0.5, random state=0) 


Now you train by using a Scikit classifier, as shown in Figure 5-16 


162 


CHAPTER 5 CHATBOT WITH TENSORFLOW 


[11 amm mg MALELLE  xJAJ CPL PEC A LES WERL. PIMSLOLA qAG Ln 


In [9]: lr = LogisticRegressioncV() 
lr.fit(train X, train y) 


Qut(9): LogisticRegressionCV(Cs»10, class welghteNone, cv=Mone, dual=False, 
fit intercepteTrue, intercept scalíngs1.8, max_iter=100, 
multi classes'ovr', n jobssl, penaltya'l2', random statesHons, 
refiteTrue, scoring=Hone, solvere'lbfgs', tol=8.0001, verbose=0) 


E an LI --- 


Figure 5-16. Using logistic regression 


Now you check the classifier accuracy: 


print("Accuracy = (:.2fj".format(lr.score(test X, test y))) 
Now we can measure the fraction of of the test set the trained classifer classifies correctly (i.e.. accuracy) 


In [10]: print("Accuracy = (:.2f)".format(lr.score(test X, test y))) 


Accuracy = 0.83 


Getting Started with a Keras Chatbot 


In this section, you will create a chatbot with Keras. Download the repo 
and perform the following steps: 


1. Create a data folder in your project directory, and 
download the Cornell Movie-Dialogs Corpus from 
the following site: 


www.cs.cornell.edu/~cristian/Cornell Movie- 


Dialogs Corpus.html 


2. Unzip the file and update config.py file«br». 
Change DATA PATH to indicate the location where 
you store your data. 


3. python3 data.py«br»s will do all the preprocessing 
for the Cornell dataset. Download Keras by using 
the following, as shown in Figure 5-17: 


Pip install keras 
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(idpFull) F:\keras\exemples>pip install keras 
Collecting keras 


Downloading https: //files.pythonhosted .org/packages/ba/65/e4af f 762bB696ec0626a6654b1e73b396f c cBb7cc6b98478a1bc5 3b85b48 /Keras -2.1.5-py2.py3- 
oer 337.3 m^ 


Requirement already satisfied: scipy»*0.14 in c: Nusers NabhisNanaconda3 \envs\idpfull\lib\site-peckeges (from keras) 
Requirement already satisfied: six>-1.9.@ in c:\users\abhis\anacondaS\envs\idpfull\lid\site-packages (from keras) 
Requirement already satisfied: nuspy»-1.9.1 in c:\users\abhis\anaconda3\envs\idpfull\lib\site-packages (from keres) 
Requirement already satisfied: pyyaml in c:\users\abhis\anaconda}\envs\idpfull\lib\site-packages (from keras) 
Installing collected packages: keras 

Successfully installed keras-2.1.5 


Figure 5-17. Downloading Keras 


Now you prepare the training set and the testing set. In Figure 5-18 you 


are accumulating data for the bot. 


‘idpFull) F:X»cd F:\ManishaBot\stanford-tensorflow-tutorials\assignments\chatbot 
idpFull) F:\ManishaBot\stanford-tensorflow-tutorials\assignments\chatbot>dir 
Volume in drive F is abhishekcontent 

Volume Serial Number is 1EA9-72D7 


Directory of F:\ManishaBot\stantord-tensorflow-tutorials\assignments\chatbot 


9-84-2018 01:33 <DIR> 


5-84-2018 01:33 <DIR> - 
9-84-2018 61:18 11,797 chatbot.py 
-2-04-2018 01:33 «DIR» checkpoints 
55-04-2018 01:27 1,394 config.py 
0-05-2011 16:12 <DIR> cornell movie-dialogs corpus 
3-84-2018 20:14 9,916,637 cornell_movie_dialogs_corpus.zip 
5-04-2018 01:24 <DIR> data 
5-84-2018 @1:18 9,744 data. py 
5-04-2018 01:18 6,394 model.py 
5-84-2018 81:18 18,354 output convo.txt 
.5-04-2018 01:28 «DIR» processed 
.5-04-28018 01:18 3,9/3 README . md 
5-04-2018 01:33 <DIR> . pycache — 
7 File(s) 9,968,193 bytes 


7 Dir(s) 68,881,727,488 bytes free 


idpFull) F:\ManishaBot\stanford-tensorflow-tutorials\assignments\chatbot>python data.py 
'reparing raw data into train set and test set ... 

wvie lines.txt 

'reparing data to be model-ready ... 


Figure 5-18. Accumulating data 


4. Type the following: 
python3 chatbot.py --mode [train/chat | 


In Figure 5-19, we are training the data. 
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(idpFull) F:\ManishaBot\stanford-tensorflow-tutorials\assignments\chatbot>python data.py 
Preparing raw data into train set and test set ... 

movie lines.txt 

Preparing data to be model-ready ... 


(idpFull) F:\ManishaBot\stanford-tensorflow-tutorials\assignments\chatbot>python chatbot.py --mode train 
Data ready! 
Bucketing conversation number 9999 
Bucketing conversation number 19999 
Bucketing conversation number 9999 
Bucketing conversation number 19999 
Bucketing conversation number 29999 
Bucketing conversation number 39999 
Bucketing conversation number 49999 
Bucketing conversation number 59999 
Bucketing conversation number 69999 
Bucketing conversation number 79999 
Bucketing conversation number 89999 
Bucketing conversation number 99999 
Bucketing conversation number 109999 
Bucketing conversation number 119999 
Bucketing conversation number 129999 
Bucketing conversation number 139999 
Bucketing conversation number 149999 
Bucketing conversation number 159999 
Bucketing conversation number 169999 
Bucketing conversation number 179999 
Bucketing conversation number 189999 
Number of samples in each bucket: 

[112038, 37505, 12832, 13776, 8597, 4758] 
Bucket scale: 

[0.5912108323747005, 0.7891201333994702, 0.8568330290333815, 0.9295272972887402, 0.9748926155372389, 1.0] 
Initialize new model 
Create placeholders 
Create inference 


Figure 5-19. Training the data 


If the mode is train, you train the chatbot. By default, the model will 
restore the previously trained weights (if there are any) and continue 
training up on that. Creating the optimizer is shown in Figure 5-20. 


See tf.nn.softmax cross entropy with, logits, v2. 


Time: 68.3281979560852 

Create optimizer... 

It might take a couple of minutes depending on how many buckets you have. 
Creating opt for bucket 8 took 18.41565442085266 seconds 

Creating opt for bucket 1 took 23.46096118343933 seconds 


Figure 5-20. Creating the optimizer 
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Now let's test the bot with the chat option, as shown in Figure 5-21. 


(idpFull) F:\ManishaBot\stanford-tensorflow-tutorials\ 
assignments\chatbot>python chatbot.py --mode chat 


(idpFull) F:\ManishaBot\stanford-tensorflow-tutorials\assignments\chatbot>python chatbot.py --mode chat 
Data ready! 

Initialize new model 

Create placeholders 

Create inference 

Creating loss... 

It might take a couple of minutes depending on how many buckets you have. 


Figure 5-21. We are enabling the chat mode 


Now the bot will use the optimizer. Figure 5-22 shows how you are 


interacting with the bot. 


Time: 68.36833882331848 

Create optimizer... 

It might take a couple of minutes depending on how many buckets you have. 

Loading parameters for the Chatbot 

Welcome to TensorBro. Say something. Enter to exit. Max length is 60 

» hello 

[[-0.17155586 @.4813461 -@.07266062 ... -0.18004592 20.03955929 
-0.04967962]] 

iiiiiiiiiiiiiiiiiii 


Figure 5-22. Interacting with the chatbot 
you have created a chatbot using Keras. You have seen how the interaction 


happens with the chatbot. In the next section, you will work on another 


chatbot application. 


Introducing nmt-chatbot 


This section introduces nmt-chatbot. This chatbot works in this order: 
1. Use translation with input and output encoders. 
2. The NMT-Bot first reads the sentence through the 


encoder. 
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3. Adecoder processes the sentence vector. 
4. The Chatbot uses LSTM approach. 
5. Tokenize the input. 


You will use Anaconda to create an environment, so let's get Anaconda 
first. Anaconda is an open source distribution for Python that is generally 
used for managing different packages. 

Let's create an environment for Anaconda and name it Manisha. 

Anaconda is available from www. anaconda . com/download/. 

Figure 5-23 shows the different versions of Anaconda. 


High-Performance Distribution Package Management Portal to Data Science 
Easily install 1.000 data science Manage packages, dependencies LUncover insights in your data and 
packages and environments with conda create Interactive visualizations 
EE Windows e: 5 à. 


Anaconda 51 For Windows Installer 


Python 3.6 version Python 2.7 version — 
& Download $ Download 

Dig Ce ycs natales 837 ME 64 Be pyri miiie muri Mi 

Lits i 12-89 Oceanic installer (ESO 


Een mewa? 
Hae to get Python 3.5 or emer Pihon versions 
Bow t Ieee AMACH DA 





Figure 5-23. Different Anaconda versions available 


After downloading Anaconda, you're ready to create the environment. 


In Windows, the process for creating an environment is as follows: 
conda create -n yourenvname python=x.x anaconda 


You then get inside the environment and install the GPU version of 
TensorFlow, as shown in Figure 5-24. 
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$ conda activate manizha 


To deactivate an active environment, wie 


"won ww 


$ gonda deactivate 


(base) C:\Windows \isystendi+comda activate manisha 


(mamisha) C:\Windows \gyeteniaspip ingrall romsarflow-gpu 
Collect ling tensor? Ica gpa 
Dewnlcading Atesa:/ tiles pythonkosted arg/nackages/23/ad/5G3ae GS 900f da PaleEdO044 14528575135 3176416779 TG5 1e F3ce b 220] tensori low qppu-1.7,0-cp36-cp36m-uin amdól. wh] (EE 
14H. | $5. 7HE A2kB/s 
Collecting tenzorboardzi.B.B,»-1.7.8 (from tenzorflow.gou] 
Dean loading hrrpgsc/fFlles,pyrhonhosred. ang/nackages/ ihi or / ebda NE EECDA 2 aT RC EG OL 07032 11 2 254 Adde ap 744 TA 22 Lá Set od /rensorbaard-1, 7, 5-nyY-none-any, wh]. CL. 148) 
Leos 1.1MB 5.4MB/* 
Collecting grpriorx-1.8.5 (fren tensortleu-gpu) 
Downloading tips c/ files prthonkortedorgpackagess Sas fos dtooJef 028 71b010123274220200b0f 24S 4f 33e Do 3d ha 36 DOS HFF al peptic- 1. 11.0-cp3ó-cpiész-win andgt, whi (1.4MB) 
Leos, 1.£HMB 3. TMB s. 
Requiretest already satlafied: xix»s1.15.6 Lm oc) \anacindayenvs ani sha libjaifte-packages (fram tensorf 1o-gpu) 
Collecting protobut?=3.4.8 (from tensarflow-gou) 
Deunlcading httpz://Filoez.pythonhozted.ang/nackapez/i2/cf/5045186d276dhOb6]d11b4 7022400628 1752350587818174c77 40632080 /protobu£-3.5.2.pozti-cpib-cpibms-uin amdó4.unl (05 
legt GIEH T.UMB/. 
Fequiresent already satisfied: wheel:sB.26 [m ci \amacondayenes ani shaxlibisitesparkages (from tensorf low-gpu) 
Collecting gastseD.:.0 (from tensoc-flow-gpu) 

Downloading https://filez.pythoanhosted.org/npackages/5c/ 7B/ HE TUA Frac2ceBaagei3?3e 'E9Sd1fEb3b7765T16910770172614 3808 1 8B 22b9b / gast B. 2, 0. tar.gz 
Collecting abzl-pys«8.1.6 [from comport low-geu) 

Doanlcading Ateps s/f files, prthonkosted orgs packagess fay be /51922 XETAbF 38e 1 f 5aed0d] PT otic TAAA A eA Tam ERE. MOSEaBAT7bd3/abs]-py-8, 1.13, tar g? (BOkB) 

1605 | 81kB. 7.4HB/5 
Collecting astors-0.6,0 (from tensor? lou-£ou) 

Downloading https://files.pythonhosted.org/packages/bl/91/ccoBgsd Lf 4 7bapfe1813e6b12a7calDíea1bo2004324C 6E M bo bc f. 2991 7T12/astor-9. B. 2- py2. py3« none any uhi] 
Regelresent already tatlifled: numgys=1.13.9 En ctVXanaconda'enys sanishaVlibisite-packages (from tensorflos-gpu) 

Collecting termcolorral.1.0 (from tensocflow-gpu) 

Downlcaeding https:/lFfibes.pythonhosted.org/nackages/Ba/AB/ a7Gbe21647d0eb94 100204 511 be 3 FK be ccletblaegedíab45173an70[GHl/termcclor.1.1.0.tar.gz 
Regeireseat already zatisficd: workzeggi-0.11.10 im cilanacecdaVesvrVmamicha lib site-packagez [from tenzorbaürccl d. 0, 3-1. 7, 0-»tonserf 1ou-gpu] 
Collecting bleaches1.5.8 (from tensorboanrdc]. 8.8, 321.7. 8» » tensor lows grou) 

Deenloading httpsc//fEbles.pythonbhosted arg packages; 11/ TAY Bbc 5 fer17ea40641RAdA36c 4 FEbOS 515655 FE T 1e 1e 135750876 398 de /b1each- 1,5. B-ny2 p 1-rmone ay . hl 
Collecting htmnitlib..0,9529399 (from tensorbosrdz1.8,0,521,7.0-»tensorflow-gpu) 

Downloading httns://*ilez.pythonhosted.org/npackages/ac/ ac/Dcb6402c 6909 32b 3204 a4 T9bb5 3870629 bedazcd17551b35632219 f b5cb FD /Pta151i1b-0.9G9209509, tae.gr (BEBUKE]) 

18. | broki F. aas 
Collect ing mumkdiowmnrs.5.B (from tensorboardc1. 8.8, 221. 7.8 tensori low-gpu 
Dewnlcoading httpac/lflles.pythonhosted.arg/nackages/63/7d/ 4B8b906 4705 96531a3457EBC T 12a011322£542dhab130423aD6 TC e ial gs /Mankdcwn-2,6.11-py2. py 3-nome-any hl (TBkB) 
piia | šik 3.948/3 
Regwirement already satisfied: setuptnols in c:Xamaconda'Venvz'umanisha,lbibwsite-packages (from protobuf»-3.4.8: »tensanf low-gpu} 
Bullding wheels for collected packages: gast, absl-py, teracolor, hraltlib 

Running setup.py bdist wheel Tor gast ... done 

Stored in directory: CrVUsensiPjJécAdaln'ApgOata Local pip Cache Wheels alt ye) 3cdecB113322b85 3008 fc 02026 9024450236 2 4E 1E4DOGC e dbA F 

Huahning setup.py bdist wheel for sbsl-py ... dene 

Stored in directory: Cr'sensP3épAdmIn' AppaazaltocalipipiCache'whgels bc yb 84 o3 f sek 53RITOBTISEDSSI TÉ cS EGAS beic sf dast 7317 

Ruming setup.py Gist wheel for termtolor ... done 

Stored in directory: C:MUsersiP35obAdain'AppOQata Local ip Cache wheels 7c 100154 bcBASSBbaldal8/ 2702476556 b175aane eE S hab DB c5abzcó 

Running zetun.py bdiist wheel for htelalib ... dene 

Stored in ditertety: CiU E'L'P3ARAdaIn' happoatalLocalpilplcachevaheels (Se ae fo dzbl Ep? ERE c fO 1d looge 10045176715: 3E EO ee cane 29 
Successfully built gast abzl:py termcolor htmislib 
Installing collected packages: protobuf, htal&lib, bleach, markdgam, Teniorboard, grpéio, gait, absl-py, astor, termcolor, tensorflow-gpu 

Found existing installation: htmlSlib 1.0.1 

Uninstalling htmislib-1.0.1: 
5Sux Cessfully aninstalled hemlsiib-1 3.1 
Found existing installation: bleach 2.1.2 
Uninstallie^g bleach-2.1.4: 
Successfully uninstalled blexhh-2.1.2 
















































Figure 5-24. Installing Tensorflow-gpu 


Import TensorFlow to check that everything is perfect and then start 
cloning the repo (a local copy of nmt-chatbot): 


git clone --recursive https://github.com/daniel-kukiela/nmt-chatbot 


Figure 5-25 shows cloning the repo. 


(es^isha) C. WnG syste Popyt 


Pythor 3.6.4 jAnecorde, Inc.| (defolt, Jon 16 2028, 106 22:22) [MOC +. 1000 04 bit (W001) oe wini 
Type "hel; “copyright”. "credits" or bLoeese* for more be*ormat Lor 
^ pon tewor*iow a t* 
(LA^ ode ev? meni oa 11bNs ite pechages Soy init oy dé: Futuredarelag: Cowersion of the second ergument of iseuidtyoe frame fleet te fleeting is depreceted. D^ feture, it will be tr 
yer 
oo com hapot register_cowerters »(& register converters 
>>> emit’) 
(@aricme) í wird \tyetemis git «low recursive “tps //githe® cone iol tente) aut chet hot 


Figure 5-25. Cloning the repo 
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Use the following command in the command windows to get inside 
the local copy copied folder that is the github copy that you cloned: 


cd nmt-chatbot 


In Figure 5-26, you are installing the requirements. 


(maniiha) C:'WIndewiVkiyitenl2»glt clone --necurilüve bttpgil)jgithub.con/danlel-kukirla/5mt-cbathet 
£lonisg iato "mwi.chattct^ 

remos: Counting objects: 810, done. 

remote: Compressing objecter 18x (113/1313), done 

Feceiving ochiectai: DOE (810/810), 11.75 MiB | 23.32 Mih/s, done, 

remote: Total #0 (delta 115), reused 128 (celta &7), park.reswzed 529 

Kesolwing deltas; 100€ (458/458), done. 

Sabmodjule "nmt" (httpsr//glithub.com/daniel-Wekiela/^net) registered for path ‘ret’ 
Clonimg dete "C:/Mindows/ syst em132 nat -rEatbot Amst... 

remos: Lanting ejects: 1111, dom. 

remote; Compressing objects; 1008 (17/17), done, 

remote: Total iiii (delta 13), reused 18 [delta 6), pack-reused 1638 

Recelwing objects: 100€ (1011/1311). 1.17 MiB | 19,33 As, done 

Resolving deltas: wae (778/778), done. 

Sebecdule path ‘net’; checked ost "dos cd BUT RM ete eer 80 T1ae T2" 


(manisha] C;'Windows*systemnl2-rd net- chatbot 


[manisha] Ci Windes Spates)? et chatbotrpip install -r requirements. tut 
FKequiremest already datlitied: teniceflow-gpus-1.4.0 in c£ encoded umani isa LEE CE Te packaged (from -P regulam. Tx (line 1)) 
Collecting toóm (/ro» or rejuinements. tt (Jine 2) 
Dese | ded heppi: jf Pl led. pythenhed t iet ong/parkages/ ?8/Ec San T sad Tipbro17173e SASod Bea LET Jw 2H 11 abri bap aber] aat asc DS egan- A. T1 B-py2.pyd-nore-amy.whL (Adie) 
idt | Sikib 2.30s 
Esquiremest siresdy tatlatied: colorama in r:ianacóndaprort'umandiba]liei4ite-packamet (from -r requiremesti.txt (line ap) 
Cellecting reges (from -r requireneets.tat (line 4j) 
Dew load httprt://fllert.pvtbonheitgec.ong/pacrkager/ Lb odie ae 4 DOLI ERU LES GT 2E T1494 bec eck ale ceed Ie? La; repez-2013.07.21-cpiti-rone-win smiid. wh] (i58bkR) 
1605 | 255k£ d aa 
collecting python-igsvesthteln (from -r requiremertt.tzt (lire 5)] 
Denm sed httpit)/lfllei.pytbonheited.aonmg/packagri/ AA agy dt oe eb rob Ht acd dda iiie Medea Jb be dl 200 bd aDaE I d/eythse-LeseniFtelis-0.12.0.tac.gz (Ak) 
SS o 0 
Requirement already aatlatied: requeitài in £:ljanaconda,bros'umadlibaNlibAiite-packages (from -r requiremsesti.txt (line B) 
i&equiremest already tatistied: tenzcrbosrdc1.3.8,521.?,8 in c VanacondaXengex Vaani sa Lib site:parkaper (from tensor loa EDU? 28.6. Beto regelrementr. txt (lime 1j) 
Requirement alreedy iatiifled: Punypy-1.13.3 in c:'aracordaVeevi'unani ial lb ite- packages (from teriorflow-gpus-L1.4.0-3-7 reguiremsenti.*xt [Liew 1)! 
&equiremest already tatistied: timed. 18.80 ia chanatai enye msni ohai l ibisi te packager (from tencorilow.ppsss] 4,8-».r requirementz.txt (line ij) 
Requirement already iatiifÓled: agtert—0.6.0 in c:lanacondaWerwi'uaclibalibMa&ite-packages (from teniocflow-ppua-1.4,0-»-r régalrementi.txE (lise 1)] 
Kequiremest already satisfied: protcbuíaos3.4. 8 de cihanacondalemerVmanishaxlibisire-parkages [From teneorflog-gps»ssi 4. 8-»-r nequiremertz.twr (line ij) 
Erquiremest alresdy xatix Tied: gaxt»-0.2.0 in c:'*anscondaenwiymanlshajlib4site-packages (from ten»crilow-ppes-1.4,0-5»-r requirenerts.tzt (line 1j) 
Waqulnemeest already zarlifled: termrolmr)2s1.2.8 ja co lane onder: vaa shas 11e te: parkapes (Feo tene ]og-ppis1.4.8-2.r regalgtements txt (lie ip) 
Pequirencet slreody satisfied; sherli-0.28 dm ci*anacondalemwsmanishailibisite-packagrs (From tenzorílow-gpet-1.4,0-*-r mequirenerts.tat (line 17) 
Wequlireseesr already sarlsfled: grprlo»ss.8.&6 [n c:'aeacordal'ueeysusan]sha* lbs Te-parkages (from Termsonflog-gpmursD.4 8-3-7 PRQÓPesenrs. rwr [lire 1]) 
Requiremest slreody zatizíled: abzl-py-9.1.5 in cianaccada'venvs umani shaslibsite-packages (from brasorflos-gpus-1,4.0-5-r reguirementz txt (line 3j) 
Wequinesest already satisfied: setupteals de cihanaceada'emus mni shaVlibisime-packages (from prhon-Levenshteln-»-r reqaulesments tst (lime 5) 
Fequirescet slresdy satisfied: chardetél.1.0,723.0,2 in ccianacondaxemes'unani sa Lib site packages (from regersts-»-r regalrementz.txt {lire 6)) 
Wequinesest already satisfied: Bdnacz.7,522.*5 dn ci hanacesda' ovs umani shalibisiTe-packages (from requests-»-£ DhIquilremenrs. tet (Bine &)) 
Requireseet slresdy zatisíled: ur1lib3«1,23,221.21,.1 in ccvmraconda vene umani sa Lib ste packages (from recgersts-»-r regalrenents.txt {lire 6)] 
Wequinemest already datlatied: certifix-2017.4.17 |n cikasacesda'vsevs umani sha Lbs iTe-packages (from requesti-»-£A Degquiremenrs. txt [line &)) 
Requircecet already satisfied: Ftalzlibe-ü.20920929 de citanacendalenwssanishaslibisite packages [from tensorboordc1.8,0, 921.7. 0- »tenzce41ow. gro 721.48, 0-7 r regulrcmentz.twt (line 11) 
Bequiremest already satisfied: maridioqwnse 2.56.8 dm cihana oida eresumanlshaklibisire-parkages (from benscriurdc] M.P, 521.7. 8- »19nscrTlow-ppurs]1.4.8-5-r requirvments 1x! (lime 11) 
Requiremest already satis¢ied! Elembhes1.5.8 in ciVseacpoedavesys'usanis^a' Db site packages (From tersonbeardot B. 221, 7.0- rtensonf lod gpussi.4.0 ee negquipements txt (line 1j] 
Esquiremezt already satisfied werkieupgsetk. 15. 1488 ln a racc aera unan 1 sa Db E n - pac bages (fram terxiconrboaricb Ro 8,ss8.7.5-5E erar Loa-gpausst QA. E-»-r requirements. Ext diine 33] 
Palling wheels fer collected packages: python Levenshteia 
Rurming setup.py bella wheel for python-Lewenkbisim ... done 
Stered im directeey: CildserziP35dAdaia SeebataLocal*pipVYcache he) iS dee YAORVEEQE RE FTLELO0UT 2 602d2 dcEJITé 46 ee EEG] B TES n F HI 
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Figure 5-26. Installing the requirements 


You also need to manage the requirements: 
pip install -r requirements.txt 

Now you open the set up folder: 
cd setup 

Then start preparing the data: 
python prepare data.py 


After preparing the data, you will get one level closer to the root in the 
folder: 


cd .. 
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Now you start training: 
python train.py 


Figure 5-27 shows the training process. 


Job id 6 
Loading hparams from model/hparams 
Updating hparams.num train steps: 1842 -> 2763 
Updating hparams.learning rate: 8.88801 -> 1le-85 
Updating hparams.epoch step: 921 -> 8 
saving hparams to model/hparams 

saving hparams to model /best_bleu\hparams 
attentionsscaled luong 

attention architecturesstandard 

avg ckptssFalse 

batch sizes128 

beam width-28 

best bleu-8 

best bleu dirsmodel/best bleu 

check special token=True 

colocate gradients with opssTrue 

decay schemes 

dev prefixs-data/tstze12.bpe 

dropoutse.2 

embed_prefix=None 

encoder typesbi 

eOSac/t5 

epoch stepzB 

forget biass1.8 

infer batch size=s32 

init opsuniform 

init weight-8.1 

learning rates1e-685 

length penalty weight-1.8 

log device placementsFalse 

max gradient normess.8 

max train=@ 

metricss['bleu'] 

num bucketsa5 

num decoder layerss2 

num decoder residual layerssü 

num embeddings partitions=6 

num encoder _layers=2 

num encoder residual layerssü 

num gpuszi 

num inter threads-e& 

num intra threads-e 

num keep ckptss-5 

num layers-2 

num train stepssz2763 

num translations per input-28 

num unitss512 

optimizersadam 

out dirsmodel/ 

output attentionsTrue 
override loaded hparamssTrue 

pass hidden statesTrue 

random seedsHone 

residual-False 

sampling temperature-8.6 

share vocabsTrue 

505-7455» 
src»from 
src embed files 


m = 


di db è odi oc 








Figure 5-27. Training process 
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After training is finished, you will get a message. Figure 5-28 shows that 


the training process is complete. 
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eval dev: perplexity 111.67, time 95, Tue &pr 17 14:36:58 J81 
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bleu best: 8.8 
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HB1B-D4-17 15:27:16.44445B5: I T:harcigithubitensorf los tensor! low yoore kernels lookup util.cciióz] Table trying to initialize from file data/'vocmb.bpe.from is slresdy initialized. 
PH1E.84.17 15:27:16.444E 1»: D Tec git tensor’ los tenzorf low core kernels lookup util.cci kod) Table trying to initialize from File data/vocasb.bpe.from is already initialized 
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Figure 5-28. The training process is complete 


Use inference. py to interact directly with the bot: 
python inference. py 


Figure 5-29 shows the inference models. 
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Figure 5-29. Inference models 
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End-to-End Systems 


End-to-end machine learning is the best approach for chatbots as we 
ingest the data through the chatbot and then score the test data. This type 
of machine learning helps in taking the decisions very faster for response 
that is very swift to communicate between user and the bot. One system 
is trained on one dataset. The chatbot makes no assumptions of the use 
cases and the dialogue and trains it on relevant data and have conversation 
of the data with user. Use Feed Forward Neural Network to implement it in 
Deep Learning. 

Before explaining further, you need to know about recurrent neural 
networks. 


Recurrent Neural Network 


Recurrent neural networks (RNNs) are useful in learning scenarios based 
on natural language processing. 

Predicting the next word in a sequence is tough. That's why we need to 
know the sequence of words prior to making a prediction. 

RNWNs are called recurrent because the same principle is applied to 
every element (phrase or a word) in a sequence, where the output is based 
upon previous computations. 

To better understand RNNs, consider this example. Say you have 
a sentence of seven words. In an RNN, you'd have to break the neural 
network into seven different layers, with one layer for each word. 

The most common RNNSs are Long short-term memory networks (LSTMs). 


LSTMs 


To resolve long-term dependencies in RNNs, you need LSTMs. These 
networks are capable of learning long short-term dependencies in a 
sequence for better predictions of the output. Figure 5-30 shows a standard 
RNN with one layer. 
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Figure 5-30. RNN 


LSTMs contain four neural network layers in a network, as illustrated 
in Figure 5-31. 





Figure 5-31. LSTM with neural network layers 


The key concept behind LSTMs are the cell states. Figure 5-32 shows 
the usage of cells. 
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Et-1 





Figure 5-32. Using the cells. The cell states formulate the way the 
communication works 


The Sigmoid layer in the LSTM outputs a value between 0 and 1. A 
value of 1 means you let all information go through it. A value of 0 means 
that nothing goes through it. Knowing these concepts, you can move along 
to the Seq2seq model. 

Seq2seq model has 


i)Encoder 
ii)Decoder 
iii)Intermediate State 


The flow is shown in Figure 5-33. 
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OUTPUT 


| 


STATE 





INPUT 


Figure 5-33. Encoder-Decoder model 


We generally use embeddings. So to recognize a sentence after that for 
doing prediction we have to make a vocabulary of words that are to be fed 
to the model to be read. Figure 5-34 shows the message process. 


ENCODER DECODER 





time step 
Figure 5-34. Message output process 
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Seq2seq vocabulary works in the following way: 


e «PAD»: During training, you need to feed your examples 
to the network in batches. The inputs in these batches 
all need to be the same width for the network to do 
its calculation. Our examples, however, are not of the 
same length. That's why you'll need to pad shorter 
inputs to bring them to the same width of the batch. 


e «EOS»: This is another necessity of batching as well, 
but more on the decoder side. It allows us to tell the 
decoder where a sentence ends, and it allows the 
decoder to indicate the same thing in its outputs. 


e «UNK»: If you're training your model on real data, you'll 
find you can vastly improve the resource efficiency of 
your model by ignoring words that don't show up often 
enough in your vocabulary to warrant consideration. 
We replace those with <UNK>. 


e «GO»: This is the input to the first time-step of the 
decoder to let the decoder know when to start 
generating output. 


Working with a Seq2seq Bot 


In this section, you will see how to work with a Seq2seq bot. We will clone 
or copy one of the GitHub repo locally and then run the bot accordingly. 
First you need to clone the repo to get inside the folder: 


https://github.com/llSourcell/tensorflow chatbot 
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Use this command to prepare the data: 
Python prepare data.py 


Then open the seq2seq. ini file and change the mode to training as. 
Use this command: 


python execute.py 


Figure 5-35 shows the training process. 


Figure 5-35. Training process 


After training, go back into the seq2seq.ini fileand update the 
mode to testing. 
When you start testing, The bot will workaround find the checkpoints 


from training and start communicating, as shown here and in Figure 5-36: 


»» Mode : test 

2018-04-20 00:15:14.408168: I C:\tf_jenkins\workspace\rel- 
win\M\windows\PY\36\tensorflow\core\platform\cpu feature guard. 
cc:137] Your CPU supports instructions that this TensorFlow 
binary was not compiled to use: AVX AVX2 
WARNING:tensorflow:From C:\Users\abhis\Anaconda3\envs\idpFull\ 
libNsite-packagesNtensorflowNpythonNopsNnn impl.py:1310: 
softmax cross entropy with logits (from tensorflow.python.ops. 
nn ops) is deprecated and will be removed in a future version. 
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Figure 5-36. Testing the bot 


Instructions for Updating 


Future major versions of TensorFlow will allow gradients to flow into the 
labels input on backprop by default. There are some expected changes in 
the later version of Tensorflow. 

See tf.nn.softmax cross entropy with logits v2. 

Reading model parameters from working dir/seq2seq.ckpt-4200. 
We are using the ckpt file created after training to see how the trained 


model works 
» hello 
Install NVIDIA's card on your computer along with drivers. 
1. Download and install CUDA. 
2. Download and “install” cuDNN. 
3. Uninstall TensorFlow, and install Tensorflow GPU. 
4. Update the ZPATH% on the system. 


5. Verify installation. 


Download and Install CUDA 


CUDA has different versions. You need CUDA version 8.0. I have 8.0, 9.0, 
and 9.1 installed and set up identically to this guide for each version. Stick 
with 8.0 for now to get that working. I set up the other versions to prepare 
for the possibility of TensorFlow GPU supporting other CUDA versions. 


178 


CHAPTER 5 CHATBOT WITH TENSORFLOW 


Here are the steps to download and install CUDA: 
Go to CUDA Toolkit downloads. 


l. 


2. 


Scroll down to Legacy Releases. 
Click the version you want (CUDA Toolkit XY): 


e For8.0, you'll see CUDA Toolkit 8.0 GA, so 


replace *<Z>* with the highest number available. 


Z is the version that is available. I downloaded 
CUDA Toolkit 8.0 GA2. 


e For 9.0, the file is CUDA Toolkit 9.0 

e For 9.1, the file is CUDA Toolkit 9.1. 

Select your operating system. Mine is as follows: 
OS: Windows 

Architecture: x86_64 

Version: 10 


After CUDA downloads, run the downloaded file 
and install it with Express Settings. This might take a 


while and flicker the screen (because of the graphics 
card). 


Verify that you have the following path on your system: 


C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v8.0 
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Download and Install cuDNN 


To install the Cuda Deep Neural Network library (CuDNN), you need an 
NVIDIA developer account. It's free. 

Create a free NVIDIA Developer Membership here: 

After you sign up, go to https: //developer.nvidia.com/cudnn. Then 
follow these steps: 


1. Clickthe Download cuDNN button (ignore the 


current listed version for now). Agree to the Terms. 


2. Remember how above we need cuDNN v6.0 from 
above? You might see this listed here, or you might 
not. If you don't, just select Archived cuDNN 
Releases. 


3. Clickthe version you need as well as the system you 
need. 


4. Download cuDNN v6.0 (April 27, 2017) for CUDA 
8.0, and then download cuDNN v6.0 Library for 
Windows 10. Unzip your recent downloaded zip file, 
such as: 


C: NUsersNteamcfeNDownloadsNcudnn-8.0-windows10-x64- 
v6.0.zip 


5. Open cuda and you should see the following: 


bin/ 
include/ 
lib/ 


6. Copy and paste the three folders from C: Users V j^ 
DownloadsNcudnn-8.0-windows10-x64-v6.0.zipN 
cuda to C:\Program Files\NVIDIA GPU Computing 
Toolkit\CUDA\v8.0. 
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Note that dragging and dropping will merge the folders and not replace 
them; I don't believe the same is true for Mac/Linux. If Cuda asks you to 
replace anything, say No and just drag and drop each folder's contents 
from cuDNN to Cuda. Cuda might as about admin privileges, in which 
case, you should just say Yes. 


7. Verify that you did the last step correctly. If you did, 
you should be able to find this path: 


C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\ 
v8.0 ML ibNx64Ncudnn. lib 


Uninstall TensorFlow, Install TensorFlow GPU 


You can remove TensorFlow from your system if it's currently installed by 


using this command: 
pip uninstall tensorflow 

You want to use TensorFlow with GPU support, and doing that is easy: 
pip install tensorflow-gpu 


I'm glad that was easy. :) 


Update the %PATH% on the System 


Update your system environment variables' PATH to have the following: 


C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v8.O\bin 
C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v8.0\libnvvp 
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Conclusion 


In this chapter, you used TensorFlow to create chatbots. You found out 

that for deep learning chatbots, LSTM is the best technique. This chapter 
also introduced Keras, and you built a chatbot with the Keras wrapper and 
TensorFlow as the back end. Finally, you looked at some common chatbots 
and reviewed a Seq2seq model approach to creating chatbots. 
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